-- Logs begin at Fri 2022-06-24 07:52:01 UTC, end at Fri 2022-06-24 09:06:25 UTC. -- Jun 24 08:33:05.407821 dv-cinder-845178-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 08:33:05.416280 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 08:33:05.418274 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 08:33:05 2022] *** Jun 24 08:33:05.418274 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 08:33:05.418274 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 08:33:05.418274 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: nodename: dv-cinder-845178-9-iscsi Jun 24 08:33:05.418274 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: machine: x86_64 Jun 24 08:33:05.418274 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: clock source: unix Jun 24 08:33:05.418274 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: pcre jit disabled Jun 24 08:33:05.418274 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: detected number of CPU cores: 4 Jun 24 08:33:05.418274 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: current working directory: / Jun 24 08:33:05.418274 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: detected binary path: /usr/bin/uwsgi-core Jun 24 08:33:05.418996 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: your processes number limit is 47680 Jun 24 08:33:05.418996 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: your memory page size is 4096 bytes Jun 24 08:33:05.418996 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: detected max file descriptor number: 2048 Jun 24 08:33:05.418996 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: lock engine: pthread robust mutexes Jun 24 08:33:05.418996 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: thunder lock: enabled Jun 24 08:33:05.418996 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 08:33:05.418996 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 08:33:05.461733 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: Python main interpreter initialized at 0x55c6878229c0 Jun 24 08:33:05.461733 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: python threads support enabled Jun 24 08:33:05.461733 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: your server socket listen backlog is limited to 100 connections Jun 24 08:33:05.461733 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: your mercy for graceful operations on workers is 90 seconds Jun 24 08:33:05.462040 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 08:33:05.462124 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: *** Operational MODE: preforking *** Jun 24 08:33:05.462322 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: *** uWSGI is running in multiple interpreter mode *** Jun 24 08:33:05.462322 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: spawned uWSGI master process (pid: 109868) Jun 24 08:33:05.462499 dv-cinder-845178-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 08:33:05.463026 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: spawned uWSGI worker 1 (pid: 109869, cores: 1) Jun 24 08:33:05.463366 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: spawned uWSGI worker 2 (pid: 109870, cores: 1) Jun 24 08:33:05.463524 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 08:33:06.120117 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:33:06.122618 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:33:07.251360 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:33:07.251360 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: from cryptography.utils import int_from_bytes Jun 24 08:33:07.252015 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:33:07.252015 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: from cryptography.utils import int_from_bytes Jun 24 08:33:07.258335 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:33:07.258335 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: from cryptography.utils import int_from_bytes Jun 24 08:33:07.258788 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:33:07.258788 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: from cryptography.utils import int_from_bytes Jun 24 08:33:09.718409 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:33:09.719071 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:33:09.719227 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:33:09.719598 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:33:09.719848 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:33:09.720233 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.720554 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.720873 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.721187 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.721511 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.721816 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.721911 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:33:09.722283 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:33:09.722374 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.722472 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.722616 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:33:09.722742 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.722982 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:33:09.723078 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.723259 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:33:09.723366 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.723633 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-9-iscsi {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.723721 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.723950 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.724049 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.724255 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.724353 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.724566 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.724675 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.724878 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.724978 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.725181 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.725275 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.725499 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.725593 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.725807 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.725905 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.726134 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.726299 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.726402 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.727464 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.727562 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.727648 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-9-iscsi {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.727724 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.727724 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.727844 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.727844 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.727976 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.728051 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.728118 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.728295 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.728378 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.728560 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.728660 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.728861 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.728946 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.729181 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.729273 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.729485 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.729684 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.729874 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-9-iscsi {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.729996 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.730190 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.730310 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.730499 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.730596 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.730806 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.730922 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.731231 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.731327 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.731541 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.731629 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.731846 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.731931 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.732162 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.732266 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.732479 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.732565 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.732783 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.732883 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.733106 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.733193 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-9-iscsi {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.733421 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.733507 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.733736 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.733828 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.734051 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.734149 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.734374 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.734503 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.734680 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.734819 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.734987 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.735134 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.735326 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.735484 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.735634 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.735811 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.735936 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.736128 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.736262 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.736458 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.736570 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.736780 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.736878 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.737097 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.737195 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.737414 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.737518 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.737663 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.737846 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.737931 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.738012 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.738212 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.738306 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.738528 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.738625 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.738834 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.738920 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.739141 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.739244 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.739470 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.739568 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.739772 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.739857 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.740076 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.740167 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.740382 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.740480 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.740683 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.740772 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.740957 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.741050 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.741212 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.741302 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.741540 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.741634 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.741865 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.741961 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.742178 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.742263 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.742488 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.742574 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.742799 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.742892 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.743108 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.743193 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.743436 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.743539 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.743747 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.743843 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.744055 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.744141 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.744365 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.744450 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.744679 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.744763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.744993 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.745076 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.745296 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.745380 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.745601 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.745693 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.745908 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.745993 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.746229 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.746341 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.746549 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.746645 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.746849 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.746945 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.747097 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.747194 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.747428 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.747536 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.747728 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.747826 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.748042 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.748149 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.748346 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.748445 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.748648 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.748745 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.748950 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.749056 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.749253 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.749350 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.749553 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.749650 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.749854 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.750475 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.750677 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.750776 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.750980 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.751069 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.751309 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.751428 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.751611 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.751700 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.751915 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.752003 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.752218 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.752315 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.752519 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.752607 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.752825 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.752941 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.753129 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.753219 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.753428 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.753522 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.753731 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.753820 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.754031 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.754129 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.754331 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.754420 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.754636 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.754724 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.754938 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.755025 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.755258 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.755351 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.755567 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.755656 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.755867 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.755955 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.756167 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.756255 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.756478 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.756574 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.756781 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.756870 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.757083 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.757170 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.757386 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.757481 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.757680 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.757775 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.757983 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.758071 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.758294 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.758380 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.758592 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.758680 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.758893 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.758982 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.759197 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.759298 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.759521 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.759610 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.759819 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.759909 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.760118 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.760215 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.760416 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.760504 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.760714 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.760843 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.761012 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.761114 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.761377 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.761476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.761634 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.761720 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.761939 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.762048 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.762239 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.762326 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.762539 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.762627 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.762842 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.762958 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.763147 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.763317 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.763481 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.763570 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.763789 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.763885 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.764097 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.764186 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.764401 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.764489 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.764723 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.764820 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.765046 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.765142 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.765356 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.765451 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.766203 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.766308 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.766511 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.766598 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.766823 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.766914 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:33:09.767131 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.767242 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.767462 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.767562 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.767779 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.767881 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.768095 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.768197 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.768419 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.768507 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.768732 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.768828 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.769046 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.769133 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.769365 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.769454 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.769672 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.769769 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.769986 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.770088 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.770308 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.770403 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.770621 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.770717 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.770931 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.771031 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.771277 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.771380 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.771602 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.771704 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.771913 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.772000 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.772234 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.772321 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.772549 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.772646 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.772857 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.772951 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.773165 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.773253 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.773471 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.773561 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.773787 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.773876 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.774108 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.774202 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.774415 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.774503 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.774729 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.774818 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.775036 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.775124 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.775369 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.775460 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.775676 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.775765 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.776246 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.776344 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.776554 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.776696 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.776884 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.776984 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.777196 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.777293 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.777506 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.777594 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.777815 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.777904 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.778129 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.778226 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.778437 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.778525 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.778747 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.778849 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.779052 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.779156 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.779387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.779477 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.779692 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.779780 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.779995 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.780103 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.780302 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.780391 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.780605 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.780728 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.780923 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.781049 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.781261 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.781348 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.781588 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.781677 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.781904 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.781994 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.782210 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.782305 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.782520 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.782608 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.782827 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.782914 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.783132 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.783239 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.783461 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.783562 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.783771 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.783869 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.784078 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.784172 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.784380 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.784720 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.784720 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.784883 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.785018 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.785108 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.785352 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.785448 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.785662 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.785750 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.785965 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.786064 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.786269 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.786367 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.786580 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.786671 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.786885 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.786976 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.787194 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.787325 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.787528 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.787623 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.787833 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.787920 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.788155 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.788257 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.788467 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.788553 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.788789 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.788886 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.789100 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.789197 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.789410 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.789499 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.789719 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.789815 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.790039 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.790134 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.790351 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.790439 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.790664 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.790759 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.790970 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.791059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.791301 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.791410 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.791606 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.791744 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.791910 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.791998 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.792211 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.792299 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.792517 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.792624 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.792818 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.792908 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.793120 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.793209 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.793420 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.793549 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.793723 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.793812 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.794026 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.794114 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.794346 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.794443 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.794652 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.794740 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.794953 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.795049 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.795277 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.795368 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.795582 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.795670 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.795893 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.795993 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.796203 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.796299 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.796512 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.796600 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.796841 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.796929 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.797155 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.797244 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.797465 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.797554 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.797787 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.797874 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.798096 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.798183 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.798402 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.798495 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.798707 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.798802 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.799013 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.799106 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.799355 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.799459 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.799675 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.799773 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.799981 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.800069 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.800298 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.800386 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.800607 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.800704 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.800926 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.801014 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.801234 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.801334 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.801549 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.801647 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.801853 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.801945 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.802164 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.802253 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.802474 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.802570 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.802789 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.802878 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.803112 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.803200 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.803454 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.803543 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.803764 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.803852 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.804074 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.804160 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.804380 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.804473 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.804688 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.804776 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.804997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.805085 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.805303 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.805391 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.805616 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.805709 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.805924 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.806012 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.806238 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.806334 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.806544 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.806631 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.806864 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.806998 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.807173 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.807333 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.807513 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.807602 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.807817 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.807918 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.808129 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.808216 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.808445 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.808533 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.808760 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.808858 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.809068 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.809154 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.809382 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.809468 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.809698 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.809793 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.810008 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.810094 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.810315 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.810408 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.810623 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.810728 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.810925 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.811013 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.811244 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.811332 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.811555 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.811653 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.811864 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.811960 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.812171 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.812263 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.813006 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.813102 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.813312 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.813402 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.813627 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.813723 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.813935 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.814024 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.814237 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.814333 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.814539 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.814627 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.814846 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.814936 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.815152 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.815252 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.815491 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.815592 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.815809 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.815897 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.816123 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.816211 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.816422 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.816517 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.816725 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.816815 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.817038 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.817132 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.817342 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.817505 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.817641 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.817730 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.817942 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.818030 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.818241 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.818341 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.818566 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.818653 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.818874 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.818962 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.819182 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.819373 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.819519 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.819608 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.819829 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.819923 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.820136 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.820223 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.820450 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.820538 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.820759 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.820865 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.821062 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.821150 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.821379 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.821511 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.821685 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.821774 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.821990 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.822077 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.822299 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.822387 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.822607 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.822704 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.822915 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.823004 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.823237 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.823330 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.823568 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.823664 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.823873 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.823968 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.824182 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.824276 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.824489 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.824585 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.824792 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.824890 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.825097 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.825193 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.825629 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.825737 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.825737 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.825971 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.826060 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.826299 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.826434 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.826612 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.826701 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.826929 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.827027 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.827270 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.827382 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.827585 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.827672 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.827901 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.827989 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.828752 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.828856 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.829075 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.829195 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.829387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.829486 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.829694 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.829945 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.830045 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.830283 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.830369 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.830588 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.830673 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.830890 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.830983 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.831192 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.831328 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.831519 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.831670 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.831826 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.831973 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.832144 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.832285 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.832417 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.832555 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.832706 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.832861 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.833018 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.833164 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.833304 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.833448 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.833586 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.833736 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.833875 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.834023 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.834170 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.834309 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.834448 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.834595 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.834735 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.834888 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.835027 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.835192 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.835351 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.835521 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.835654 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.835831 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.835992 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.836137 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.836294 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.836447 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.836628 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.836763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.836953 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.837071 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.837290 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.837379 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.837593 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.837682 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.837896 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.837984 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.838215 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.838313 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.838518 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.838607 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.838821 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.838916 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.839122 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.839263 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.839456 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.839557 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.839763 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.839859 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.840064 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.840162 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.840371 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.840466 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.840677 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.840775 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.840983 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.841072 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.841288 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.841378 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.841591 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.841770 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.841895 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.841985 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.842196 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.842296 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.842506 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.842608 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.842813 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.842902 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.843112 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.843201 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.843467 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.843602 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.843767 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.843859 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.844074 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.844170 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.844374 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.844464 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.844680 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.844770 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.844979 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.845069 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.845292 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.845380 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.845592 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.845679 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.845893 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.845983 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.846193 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.846283 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.846499 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.846586 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.846802 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.846899 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.847102 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.847200 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.847441 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.847564 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.847746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.847845 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.848048 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.848143 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.848350 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.848435 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.848655 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.848749 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.848955 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.849043 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.849261 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.849346 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.849566 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.849664 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.849878 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.849962 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.850189 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.850275 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.850490 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.850597 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.850799 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.850894 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.851100 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.851186 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.851427 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.851515 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.851729 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.851815 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.852035 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.852122 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.852338 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.852436 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.852638 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.852725 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.852939 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.853025 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.853240 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.853328 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.853541 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.853627 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.853860 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.853955 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.854166 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.854253 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.854466 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.854553 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.854772 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.854870 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.855070 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.855155 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.855406 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.855502 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.855717 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.855811 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.856027 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.856117 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.856335 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.856423 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.856660 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.856754 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.856955 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.857057 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.857259 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.857345 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.857571 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.857680 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.857876 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.857961 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.858176 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.858268 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.858481 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.858568 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.858786 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.858878 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.859095 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.859189 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.859457 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.859553 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.859761 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.859848 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.860080 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.860166 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.860389 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.860477 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.860696 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.860789 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.861012 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.861097 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.861332 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.861419 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.861643 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.861735 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.861944 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.862037 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.862247 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.862335 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.862556 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.862657 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.862860 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.862959 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.863165 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.863280 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.863496 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.863581 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.863803 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.863899 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.864110 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.864196 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.864417 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.864503 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.864725 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.864823 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.865033 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.865119 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.865333 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.865419 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.865640 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.865734 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.865946 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.866040 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.866249 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.866337 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.866562 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.866647 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.866867 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.866959 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.867169 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.867310 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.867498 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.867597 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.867803 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.867908 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.868107 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.868194 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.868410 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.868497 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.868715 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.868832 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.869027 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.869144 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.869340 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.869452 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.869648 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.869754 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.869976 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.870140 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.870290 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.870378 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.870598 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.870685 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.870909 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.871003 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.871238 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.871328 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.871554 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.871655 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.871863 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.872015 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.872251 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.872336 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.872559 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.872644 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.872862 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.872961 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.873168 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.873255 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.873477 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.873562 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.873788 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.873882 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.874091 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.874183 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.874395 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.874481 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.874698 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.874785 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.875544 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.875640 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.875852 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.875954 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.876170 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.876258 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.876552 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.876637 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.876864 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.876987 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.877175 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.877269 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.877488 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.877580 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.877862 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.877997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.878134 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.878234 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.878444 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.878538 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.878754 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.878888 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.879080 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.879169 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.879418 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.879506 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.879734 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.879834 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.880042 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.880150 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.880365 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.880451 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.880686 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.880781 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.880995 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.881161 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.881305 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.881465 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.881609 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.881779 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.881929 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.882107 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.882251 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.882433 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.882560 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.882761 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.882879 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.883071 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.883319 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.883422 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.883645 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.883734 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.883954 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.884042 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.884272 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.884359 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.884603 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.884691 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.884901 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.884988 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.885206 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.885293 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.885514 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.885600 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.885816 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.885903 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.886117 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.886213 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.886436 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.886532 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.886740 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.886870 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.887046 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.887198 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.887379 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.887532 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.887685 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.887856 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.887999 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.888187 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.888282 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.888497 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.888585 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.888815 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.888921 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.889118 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.889219 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.889450 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.889538 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.889759 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.889853 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.890085 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.890181 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.890395 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.890489 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.891268 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.891386 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.891588 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.891684 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.891890 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.891975 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.892194 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.892281 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.892496 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.892592 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.892821 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.892906 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.893125 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.893218 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.893444 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.893578 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.893759 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.893844 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.894084 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.894171 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.894394 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.894479 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.894704 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.894790 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.895029 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.895115 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.895364 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.895453 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.895672 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.895757 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.895984 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.896081 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.896286 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.896384 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.896590 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.896684 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.896899 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.896993 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.897201 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.897289 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.897502 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.897594 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.897803 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.897898 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.898108 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.898202 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.898409 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.898495 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.898709 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.898808 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.899012 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.899098 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.899357 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.899452 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.899665 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.899770 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.899984 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.900078 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.900291 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.900387 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.900592 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.900680 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.901163 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.901263 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.901465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.901552 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.901794 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.901880 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.902093 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.902177 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.902401 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.902496 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.902710 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.902798 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.903016 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.903112 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.903364 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.903453 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.903671 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.903759 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.903996 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.904082 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.904308 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.904402 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.904617 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.904713 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.904928 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.905022 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.905233 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.905329 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.905545 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.905631 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.905859 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.905945 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.906171 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.906271 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.906501 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.906587 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.906817 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.906904 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.907132 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.907281 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.907478 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.907577 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.907806 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.907991 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.908133 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.908322 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.908456 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.908643 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.908780 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.908949 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.909101 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.909260 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.909421 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.909573 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.909741 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.909891 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.910062 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.910200 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.910377 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.910510 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.910700 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.910819 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.911021 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.911117 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.911372 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.911467 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.911778 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.911900 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.912103 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.912232 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.912436 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.912555 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.912751 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.912873 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.913065 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.913190 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.913377 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.913509 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.913688 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.913828 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.914040 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.914130 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.914353 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.914439 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.914659 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.914747 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.914969 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.915056 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.915301 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.915403 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.915615 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.915709 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.915926 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.916016 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.916233 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.916334 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.916543 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.916653 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.916851 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.916945 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.917159 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.917255 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.917474 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.917587 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.917774 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.917898 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.918084 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.918217 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.918407 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.918529 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.918737 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.918832 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.919053 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.919141 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.919393 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.919514 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.919708 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.919812 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.920019 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.920120 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.920383 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.920536 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.920698 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.920851 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.921012 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.921182 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.921327 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.921506 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.921645 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.921848 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.921994 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.922165 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.922324 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.922487 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.922664 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.922811 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.923039 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.923156 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.923323 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.923428 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.923643 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.923743 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.923960 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.924055 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.924308 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.924485 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.924627 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.924806 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.924935 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.925143 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.925233 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.925474 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.925573 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.925805 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.925895 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.926125 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.926345 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.926582 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.926683 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.926769 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.926988 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.927084 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.927336 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.927454 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.927665 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.927767 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.927977 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.928065 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.928282 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.928396 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.928608 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.928705 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.928911 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.928999 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.929217 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.929322 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.929529 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.929618 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.929840 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.929928 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.930143 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.930380 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.930470 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.930727 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.930830 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.931041 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.931129 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.931369 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.931462 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.931679 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.931769 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.931982 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.932084 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.932307 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.932396 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.932612 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.932713 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.932916 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.933016 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.933222 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.933322 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.933528 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.933619 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.933829 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.933928 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.934132 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.934230 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.934434 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.934523 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.934736 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.934834 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.935045 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.935134 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.935373 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.935462 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.935681 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.935770 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.935983 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.936078 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.936290 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.936378 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.936591 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.936689 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.936897 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.936986 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.937201 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.937290 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.938034 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.938135 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.938349 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.938478 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.938652 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.938760 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.938961 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.939049 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.939291 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.939393 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.939606 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.939692 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.939915 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.940001 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.940227 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.940313 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.940536 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.940696 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.940849 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.940935 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.941162 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.941383 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.941476 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.941715 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.941807 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.942033 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.942124 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.942366 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.942469 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.942696 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.942798 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.943001 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.943092 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.943332 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.943448 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.943635 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.943724 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.943955 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.944044 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.944263 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.944362 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.944572 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.944662 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.944876 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.944966 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.945185 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.945437 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.945529 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.945781 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.945870 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.946082 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.946170 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.946389 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.946491 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.946694 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.946783 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.946998 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.947096 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.947325 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.947420 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.947631 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.947732 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.947936 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.948034 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.948244 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.948345 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.948584 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.948682 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.948897 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.948996 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.949211 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.949300 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.949521 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.949618 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.949834 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.949929 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.950144 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.950233 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.950450 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.950538 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.950760 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.950852 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.951068 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.951159 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.951399 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.951488 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.951714 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.951805 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.952027 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.952125 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.952328 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.952425 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.952680 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.952834 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.953007 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.953096 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.953876 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.953988 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.954192 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.954280 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.954499 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.954588 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.954816 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.954918 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.955130 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.955239 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.955463 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.955551 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.955777 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.955883 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.956084 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.956172 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.956416 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.956558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.956737 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.956902 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.957048 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.957229 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.957469 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.957565 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.957787 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.957878 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.958110 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.958208 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.958428 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.958525 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.958734 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.958831 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.959051 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.959150 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.959384 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.959489 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.959687 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.959777 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.959988 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.960078 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.960299 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.960401 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.960600 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.960698 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.960900 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.960990 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.961202 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.961300 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.961502 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.961598 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.961807 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.961908 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.962108 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.962199 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.962409 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.962499 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.962708 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.962797 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.963009 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.963102 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.963332 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.963427 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.963634 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.963723 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.963939 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.964031 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.964241 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.964331 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.964543 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.964632 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.964844 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.964934 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.965143 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.965240 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.965444 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.965542 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.965772 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.965861 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.966075 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.966162 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.966383 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.966485 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.966690 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.966780 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.966995 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.967084 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.967328 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.967431 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.967640 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.967736 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.967953 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.968042 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.968259 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.968396 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.968611 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.968709 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.968899 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.969025 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.969207 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.969306 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.969512 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.969601 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.969824 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.969911 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.970138 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.970230 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.970446 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.970536 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.970754 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.970843 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.971063 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.971153 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.971411 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.971503 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.971729 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.971829 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.972031 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.972127 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.972351 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.972452 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.972666 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.972766 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.972979 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.973066 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.973288 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.973376 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.973596 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.973694 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.973913 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.974047 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.974217 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.974305 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.974521 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.974624 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.974831 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.974927 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.975135 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.975243 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.975469 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.975560 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.975781 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.975877 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.976092 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.976182 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.976417 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.976507 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.976735 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.976822 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.977041 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.977128 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.977365 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.977454 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.977680 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.977770 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.978013 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.978116 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.978322 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.978410 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.978635 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.978733 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.978952 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.979060 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.979290 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.979388 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.979599 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.979688 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.979903 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.980005 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.980150 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:33:09.980240 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.980540 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.980872 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.981188 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.981520 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.981852 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.982201 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.982523 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.982869 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.983202 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.983545 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.983861 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.984172 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:33:09.984942 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:33:10.133531 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO dbcounter [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] Registered counter for database nova_api Jun 24 08:33:10.137904 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO dbcounter [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] Registered counter for database nova_api Jun 24 08:33:10.154083 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG oslo_db.sqlalchemy.engines [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:33:10.158957 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_db.sqlalchemy.engines [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:33:10.161260 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG dbcounter [-] [109870] Writer thread running {{(pid=109870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:33:10.165479 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG dbcounter [-] [109869] Writer thread running {{(pid=109869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:33:10.217931 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.context [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3f4411ef-81df-4f69-8e58-a68a240933fd(cell1) {{(pid=109870) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:33:10.222514 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG oslo_concurrency.lockutils [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:10.223072 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.context [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3f4411ef-81df-4f69-8e58-a68a240933fd(cell1) {{(pid=109869) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:33:10.224054 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG oslo_concurrency.lockutils [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:10.224847 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG oslo_concurrency.lockutils [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:10.226819 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG oslo_concurrency.lockutils [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:10.226983 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:10.228609 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:10.228796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO dbcounter [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] Registered counter for database nova_cell0 Jun 24 08:33:10.229422 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:33:10.231423 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:33:10.232804 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO dbcounter [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] Registered counter for database nova_cell1 Jun 24 08:33:10.233475 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO dbcounter [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] Registered counter for database nova_cell0 Jun 24 08:33:10.237502 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO dbcounter [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] Registered counter for database nova_cell1 Jun 24 08:33:10.241642 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG oslo_db.sqlalchemy.engines [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:33:10.242196 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG oslo_db.sqlalchemy.engines [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:33:10.244269 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_db.sqlalchemy.engines [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:33:10.246715 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG dbcounter [-] [109870] Writer thread running {{(pid=109870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:33:10.248224 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_db.sqlalchemy.engines [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:33:10.249958 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG dbcounter [-] [109869] Writer thread running {{(pid=109869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:33:10.386569 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG dbcounter [-] [109870] Writer thread running {{(pid=109870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:33:10.394244 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG dbcounter [-] [109869] Writer thread running {{(pid=109869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:33:10.396838 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO dbcounter [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] Registered counter for database nova_cell0 Jun 24 08:33:10.403220 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO dbcounter [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] Registered counter for database nova_cell0 Jun 24 08:33:10.405692 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG oslo_db.sqlalchemy.engines [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:33:10.410414 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG dbcounter [-] [109870] Writer thread running {{(pid=109870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:33:10.411620 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_db.sqlalchemy.engines [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:33:10.415891 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG dbcounter [-] [109869] Writer thread running {{(pid=109869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:33:10.743180 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: WARNING keystonemiddleware.auth_token [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:33:10.746008 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: WARNING keystonemiddleware.auth_token [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:33:10.750895 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: WARNING keystonemiddleware.auth_token [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:33:10.753781 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: WARNING keystonemiddleware.auth_token [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:33:11.086867 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: WARNING keystonemiddleware.auth_token [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:33:11.092639 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: WARNING keystonemiddleware.auth_token [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:33:11.092788 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: WARNING keystonemiddleware.auth_token [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:33:11.098064 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c6878229c0 pid: 109869 (default app) Jun 24 08:33:11.098548 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: WARNING keystonemiddleware.auth_token [None req-9cb7face-e71a-4cb4-b484-548d5985e703 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:33:11.100174 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:33:11.101336 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001731 Jun 24 08:33:11.101740 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Fri Jun 24 08:33:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:33:11.103810 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c6878229c0 pid: 109870 (default app) Jun 24 08:34:25.697495 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:25.699183 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Jun 24 08:34:25.699873 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 930 bytes} [Fri Jun 24 08:34:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:25.712481 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG dbcounter [-] [109870] Writing DB stats nova_api:SELECT=3 {{(pid=109870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:25.714154 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG dbcounter [-] [109870] Writing DB stats nova_cell1:SELECT=3 {{(pid=109870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:25.715163 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG dbcounter [-] [109870] Writing DB stats nova_cell0:SELECT=3 {{(pid=109870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:25.716454 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG dbcounter [-] [109870] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:26.167556 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-5f6985bb-8294-4743-b453-52073d0ac34b admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:26.198175 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-5f6985bb-8294-4743-b453-52073d0ac34b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.490841 Jun 24 08:34:26.199115 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1291 bytes} [Fri Jun 24 08:34:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:34:28.252621 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:28.253627 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-258904f0-c940-409e-b50a-fa77d8a36ae5 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 24 08:34:28.254036 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 930 bytes} [Fri Jun 24 08:34:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:28.314937 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-77888543-94e5-48b3-a103-f69b38c270fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:28.333327 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:34:28.333327 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: warnings.warn(msg) Jun 24 08:34:28.362153 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-77888543-94e5-48b3-a103-f69b38c270fa admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102066 Jun 24 08:34:28.362695 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Jun 24 08:34:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:34:28.379242 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG dbcounter [-] [109869] Writing DB stats nova_api:SELECT=3 {{(pid=109869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:28.380068 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG dbcounter [-] [109869] Writing DB stats nova_cell0:SELECT=3 {{(pid=109869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:28.381351 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG dbcounter [-] [109869] Writing DB stats nova_cell1:SELECT=3 {{(pid=109869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:28.382093 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG dbcounter [-] [109869] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:28.593205 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-9bd37ffc-89ea-4c96-823a-91dede332e23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:28.595744 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:34:28.595744 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: warnings.warn(msg) Jun 24 08:34:28.660569 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-9bd37ffc-89ea-4c96-823a-91dede332e23 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289413 Jun 24 08:34:28.661592 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1335 bytes} [Fri Jun 24 08:34:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:34:30.757401 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-77888543-94e5-48b3-a103-f69b38c270fa admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:30.758419 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-77888543-94e5-48b3-a103-f69b38c270fa admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 24 08:34:30.758823 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 930 bytes} [Fri Jun 24 08:34:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:30.863007 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-a4433ddf-9160-4b0c-87d7-9378b8d2df86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "disk": 5, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:30.881038 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:34:30.881038 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: warnings.warn(msg) Jun 24 08:34:30.901110 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-a4433ddf-9160-4b0c-87d7-9378b8d2df86 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135867 Jun 24 08:34:30.901916 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Jun 24 08:34:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:34:30.913681 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-d8852751-ba15-4c0d-884e-01235f8a61c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:30.915170 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:34:30.915170 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: warnings.warn(msg) Jun 24 08:34:30.951238 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-d8852751-ba15-4c0d-884e-01235f8a61c1 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037348 Jun 24 08:34:30.951238 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1335 bytes} [Fri Jun 24 08:34:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:34:33.017064 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-a4433ddf-9160-4b0c-87d7-9378b8d2df86 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:33.018122 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-a4433ddf-9160-4b0c-87d7-9378b8d2df86 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jun 24 08:34:33.018518 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 930 bytes} [Fri Jun 24 08:34:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:33.080616 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-64c443b4-92b2-49d6-a449-63a76cff9f57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "id": "d2", "swap": 0, "vcpus": 1, "ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:33.098002 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-64c443b4-92b2-49d6-a449-63a76cff9f57 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073444 Jun 24 08:34:33.098548 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Jun 24 08:34:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:34:33.110403 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-6edec31a-f29f-4ec2-a94b-ec62e757c4b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:33.135339 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-6edec31a-f29f-4ec2-a94b-ec62e757c4b2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028486 Jun 24 08:34:33.136234 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1335 bytes} [Fri Jun 24 08:34:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:34:35.208093 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-64c443b4-92b2-49d6-a449-63a76cff9f57 admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:35.209144 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-64c443b4-92b2-49d6-a449-63a76cff9f57 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jun 24 08:34:35.209626 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 930 bytes} [Fri Jun 24 08:34:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:35.274205 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-ea2ea0d5-bc81-434c-ad66-315ac863716a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "disk": 10, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:35.292095 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-ea2ea0d5-bc81-434c-ad66-315ac863716a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076521 Jun 24 08:34:35.292662 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Jun 24 08:34:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:34:35.305161 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-b604f30a-99af-4d75-83f4-37887ce19b7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:35.326937 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-b604f30a-99af-4d75-83f4-37887ce19b7f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025623 Jun 24 08:34:35.327675 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1335 bytes} [Fri Jun 24 08:34:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:34:37.404203 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-ea2ea0d5-bc81-434c-ad66-315ac863716a admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:37.405204 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-ea2ea0d5-bc81-434c-ad66-315ac863716a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Jun 24 08:34:37.405594 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 930 bytes} [Fri Jun 24 08:34:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:34:37.463559 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-f84577eb-5beb-495f-af34-e946d99cacdf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0}} {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:37.480593 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-f84577eb-5beb-495f-af34-e946d99cacdf admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069384 Jun 24 08:34:37.481129 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Jun 24 08:34:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:34:37.492708 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-264c4a38-c14e-4369-bc9e-5ae89f05fef7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:37.515319 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-264c4a38-c14e-4369-bc9e-5ae89f05fef7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026207 Jun 24 08:34:37.516052 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1335 bytes} [Fri Jun 24 08:34:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:34:39.595858 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-f84577eb-5beb-495f-af34-e946d99cacdf admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:39.596873 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-f84577eb-5beb-495f-af34-e946d99cacdf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jun 24 08:34:39.597266 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 930 bytes} [Fri Jun 24 08:34:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:39.656306 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-80b451bc-1a71-41c4-a54d-5b3cd7aea1ff admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:39.679986 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-80b451bc-1a71-41c4-a54d-5b3cd7aea1ff admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076554 Jun 24 08:34:39.680717 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1291 bytes} [Fri Jun 24 08:34:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:34:41.779255 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-f84577eb-5beb-495f-af34-e946d99cacdf admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:41.780802 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-f84577eb-5beb-495f-af34-e946d99cacdf admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 Jun 24 08:34:41.784756 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 930 bytes} [Fri Jun 24 08:34:41 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:41.850446 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-2d78548d-d12c-467b-944c-1f090780346d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "rxtx_factor": 1.0, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1}} {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:41.869479 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-2d78548d-d12c-467b-944c-1f090780346d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082531 Jun 24 08:34:41.870211 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Jun 24 08:34:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:34:41.882917 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-8e14b5ee-c44e-4962-8908-52f74a7e555b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:41.908125 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-8e14b5ee-c44e-4962-8908-52f74a7e555b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028847 Jun 24 08:34:41.908703 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1332 bytes} [Fri Jun 24 08:34:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:34:44.272815 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-2d78548d-d12c-467b-944c-1f090780346d admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:44.273877 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-2d78548d-d12c-467b-944c-1f090780346d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 24 08:34:44.274238 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 930 bytes} [Fri Jun 24 08:34:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:44.335256 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-80ae42a5-fcdd-4658-ac67-736f1c9d7dcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "swap": 0, "ram": 2048}} {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:44.352667 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-80ae42a5-fcdd-4658-ac67-736f1c9d7dcb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072068 Jun 24 08:34:44.353218 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Jun 24 08:34:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:34:44.365278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-07bf29df-04b0-4d58-b68e-4a6c2209d45d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:44.387677 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-07bf29df-04b0-4d58-b68e-4a6c2209d45d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026061 Jun 24 08:34:44.388408 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1332 bytes} [Fri Jun 24 08:34:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:34:46.472965 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-80ae42a5-fcdd-4658-ac67-736f1c9d7dcb admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:46.474028 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-80ae42a5-fcdd-4658-ac67-736f1c9d7dcb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jun 24 08:34:46.474433 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 930 bytes} [Fri Jun 24 08:34:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:46.544286 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-199f7d94-851a-4070-ad4d-aeb82dbdfb84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "id": "3", "name": "m1.medium"}} {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:46.562725 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-199f7d94-851a-4070-ad4d-aeb82dbdfb84 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.082587 Jun 24 08:34:46.563301 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Jun 24 08:34:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:34:46.576468 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-1e3a4ad2-48e1-4944-80b4-a76f169f86ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:46.602282 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-1e3a4ad2-48e1-4944-80b4-a76f169f86ef admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030639 Jun 24 08:34:46.602888 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1332 bytes} [Fri Jun 24 08:34:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:34:48.662624 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-199f7d94-851a-4070-ad4d-aeb82dbdfb84 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:48.663712 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-199f7d94-851a-4070-ad4d-aeb82dbdfb84 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jun 24 08:34:48.664113 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 930 bytes} [Fri Jun 24 08:34:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:48.721275 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-7bdf01eb-a22a-426b-85bf-8617ed98cd91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:48.740745 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-7bdf01eb-a22a-426b-85bf-8617ed98cd91 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070910 Jun 24 08:34:48.741285 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Jun 24 08:34:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:34:48.753075 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-c0ced2a8-5079-4225-bf28-4532c0773a72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:48.776083 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-c0ced2a8-5079-4225-bf28-4532c0773a72 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026755 Jun 24 08:34:48.776641 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1332 bytes} [Fri Jun 24 08:34:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:34:50.829392 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-7bdf01eb-a22a-426b-85bf-8617ed98cd91 admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:34:50.830397 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-7bdf01eb-a22a-426b-85bf-8617ed98cd91 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 24 08:34:50.830792 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 930 bytes} [Fri Jun 24 08:34:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:34:50.890970 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-12b0b778-1d5e-4f84-a518-919990bebf12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "swap": 0}} {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:50.910267 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-12b0b778-1d5e-4f84-a518-919990bebf12 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073475 Jun 24 08:34:50.910827 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1282 bytes} [Fri Jun 24 08:34:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:34:50.923172 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-9dacaa70-fcce-462a-9c49-f3a3881e53ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:34:50.949745 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-9dacaa70-fcce-462a-9c49-f3a3881e53ff admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030357 Jun 24 08:34:50.950656 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1332 bytes} [Fri Jun 24 08:34:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:35:16.126783 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-12b0b778-1d5e-4f84-a518-919990bebf12 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:16.127829 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-12b0b778-1d5e-4f84-a518-919990bebf12 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 24 08:35:16.128254 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 930 bytes} [Fri Jun 24 08:35:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:35:16.138704 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG dbcounter [-] [109870] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:16.187237 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-e0b589b8-c5fd-4d1a-a6bf-45f18ad76f99 admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:16.203941 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-e0b589b8-c5fd-4d1a-a6bf-45f18ad76f99 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069800 Jun 24 08:35:16.204468 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1291 bytes} [Fri Jun 24 08:35:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:35:17.111857 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-12b0b778-1d5e-4f84-a518-919990bebf12 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:17.112862 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-12b0b778-1d5e-4f84-a518-919990bebf12 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 24 08:35:17.113259 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Jun 24 08:35:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:35:17.301390 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-09d67195-676a-4787-ab33-6c1d6fa67f22 admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:17.307020 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.wsgi [None req-09d67195-676a-4787-ab33-6c1d6fa67f22 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-09d67195-676a-4787-ab33-6c1d6fa67f22 admin admin] Request method failure captured: Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Accept: application/json Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Accept-Encoding: gzip, deflate Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Connection: keep-alive Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Content-Length: 0 Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Host: 10.222.0.43 Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Openstack-Api-Version: compute 2.90 Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Openstack-System-Scope: None Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: User-Agent: python-novaclient Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Auth-Token: gAAAAABitXdF2SBF-u6cdxRa_rWtSymICwWC9FEJseqpRdXyMCg-RpKUSDI9eSvNZtMDE3Kk4tkmTIFMAAJAeWBoJpSMRUa8sE2q9ZBp2dgHvb7DJpsZ4XuwyjCD1iJpO2wPccOrT6_r9XbB1G6d-F4Gw_WXtB7b9zecwsH_BU3sMjeRmdHra7I Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Domain-Id: None Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Domain-Name: None Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Identity-Status: Confirmed Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Is-Admin-Project: True Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Project-Domain-Id: default Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Project-Domain-Name: Default Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Project-Id: ffa0e0eb99bd42cebd2bc5b9d635fa5d Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Project-Name: admin Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Role: admin,member,reader Jun 24 08:35:17.310796 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Roles: admin,member,reader Jun 24 08:35:17.312465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ffa0e0eb99bd42cebd2bc5b9d635fa5d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:35:17.312465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Tenant: admin Jun 24 08:35:17.312465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Tenant-Id: ffa0e0eb99bd42cebd2bc5b9d635fa5d Jun 24 08:35:17.312465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Tenant-Name: admin Jun 24 08:35:17.312465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User: admin Jun 24 08:35:17.312465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User-Domain-Id: default Jun 24 08:35:17.312465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User-Domain-Name: Default Jun 24 08:35:17.312465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User-Id: ca1ff62a97334431beecc4658e2e8e61 Jun 24 08:35:17.312465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User-Name: admin Jun 24 08:35:17.312465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: method: > Jun 24 08:35:17.312465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: exception: Flavor 42 could not be found. Jun 24 08:35:17.312465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: action_args: {'id': '42'} Jun 24 08:35:17.312465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:35:17.312465 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:35:17.313341 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:17.314966 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-09d67195-676a-4787-ab33-6c1d6fa67f22 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:35:17.316273 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-09d67195-676a-4787-ab33-6c1d6fa67f22 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061943 Jun 24 08:35:17.316273 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Fri Jun 24 08:35:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:35:17.321762 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-2907f0cb-c8a7-4764-ad14-8a44ca54d380 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:17.324716 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG dbcounter [-] [109869] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:17.344856 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-2907f0cb-c8a7-4764-ad14-8a44ca54d380 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026676 Jun 24 08:35:17.345392 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Fri Jun 24 08:35:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:35:17.355069 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-ab25563e-d1ad-41fa-ab3a-c130a87075be admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:17.377761 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-ab25563e-d1ad-41fa-ab3a-c130a87075be admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026515 Jun 24 08:35:17.378282 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Fri Jun 24 08:35:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:35:17.387518 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-46c85e64-db2b-43e3-91f5-ebd711bffb37 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:17.394441 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.wsgi [None req-46c85e64-db2b-43e3-91f5-ebd711bffb37 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-46c85e64-db2b-43e3-91f5-ebd711bffb37 admin admin] Request method failure captured: Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Accept: application/json Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Accept-Encoding: gzip, deflate Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Connection: keep-alive Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Content-Length: 0 Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Host: 10.222.0.43 Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Openstack-Api-Version: compute 2.90 Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Openstack-System-Scope: None Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: User-Agent: python-novaclient Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Auth-Token: gAAAAABitXdF2SBF-u6cdxRa_rWtSymICwWC9FEJseqpRdXyMCg-RpKUSDI9eSvNZtMDE3Kk4tkmTIFMAAJAeWBoJpSMRUa8sE2q9ZBp2dgHvb7DJpsZ4XuwyjCD1iJpO2wPccOrT6_r9XbB1G6d-F4Gw_WXtB7b9zecwsH_BU3sMjeRmdHra7I Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Domain-Id: None Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Domain-Name: None Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Identity-Status: Confirmed Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Is-Admin-Project: True Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Project-Domain-Id: default Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Project-Domain-Name: Default Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Project-Id: ffa0e0eb99bd42cebd2bc5b9d635fa5d Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Project-Name: admin Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Role: admin,member,reader Jun 24 08:35:17.397733 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Roles: admin,member,reader Jun 24 08:35:17.399297 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ffa0e0eb99bd42cebd2bc5b9d635fa5d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:35:17.399297 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Tenant: admin Jun 24 08:35:17.399297 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Tenant-Id: ffa0e0eb99bd42cebd2bc5b9d635fa5d Jun 24 08:35:17.399297 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Tenant-Name: admin Jun 24 08:35:17.399297 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User: admin Jun 24 08:35:17.399297 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User-Domain-Id: default Jun 24 08:35:17.399297 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User-Domain-Name: Default Jun 24 08:35:17.399297 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User-Id: ca1ff62a97334431beecc4658e2e8e61 Jun 24 08:35:17.399297 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User-Name: admin Jun 24 08:35:17.399297 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: method: > Jun 24 08:35:17.399297 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: exception: Flavor 42 could not be found. Jun 24 08:35:17.399297 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: action_args: {'id': '42'} Jun 24 08:35:17.399297 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:35:17.399297 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:35:17.400278 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:17.401790 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-46c85e64-db2b-43e3-91f5-ebd711bffb37 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:35:17.403289 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-46c85e64-db2b-43e3-91f5-ebd711bffb37 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015087 Jun 24 08:35:17.403289 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Fri Jun 24 08:35:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:35:18.221980 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-ab25563e-d1ad-41fa-ab3a-c130a87075be admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:18.222990 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-ab25563e-d1ad-41fa-ab3a-c130a87075be admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 24 08:35:18.223562 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Jun 24 08:35:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:35:18.413287 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-658a3fcf-fee1-4651-9ad5-bdde83561f3e admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:18.420691 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.wsgi [None req-658a3fcf-fee1-4651-9ad5-bdde83561f3e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-658a3fcf-fee1-4651-9ad5-bdde83561f3e admin admin] Request method failure captured: Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Accept: application/json Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Accept-Encoding: gzip, deflate Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Connection: keep-alive Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Content-Length: 0 Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Host: 10.222.0.43 Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Openstack-Api-Version: compute 2.90 Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Openstack-System-Scope: None Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: User-Agent: python-novaclient Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Auth-Token: gAAAAABitXdG7yEdBoUm2d0WAoqfS6GmIh2S-8adAj3Upjes8UsarEwJraW4UA0AclqplLG--UsWuOL4pPfvmJGD6lORIIzHff6tousZ_UfbxeYyauuXiSrbQyOp_8NS_GtjINP2OdhM2ZuW2i_yX4-igvxUSwyTYmElMHkuGRPkUUn8RU7H8ys Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Domain-Id: None Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Domain-Name: None Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Identity-Status: Confirmed Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Is-Admin-Project: True Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Project-Domain-Id: default Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Project-Domain-Name: Default Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Project-Id: ffa0e0eb99bd42cebd2bc5b9d635fa5d Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Project-Name: admin Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Role: admin,member,reader Jun 24 08:35:18.422229 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Roles: admin,member,reader Jun 24 08:35:18.423822 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ffa0e0eb99bd42cebd2bc5b9d635fa5d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:35:18.423822 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Tenant: admin Jun 24 08:35:18.423822 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Tenant-Id: ffa0e0eb99bd42cebd2bc5b9d635fa5d Jun 24 08:35:18.423822 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Tenant-Name: admin Jun 24 08:35:18.423822 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User: admin Jun 24 08:35:18.423822 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User-Domain-Id: default Jun 24 08:35:18.423822 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User-Domain-Name: Default Jun 24 08:35:18.423822 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User-Id: ca1ff62a97334431beecc4658e2e8e61 Jun 24 08:35:18.423822 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User-Name: admin Jun 24 08:35:18.423822 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: method: > Jun 24 08:35:18.423822 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: exception: Flavor 84 could not be found. Jun 24 08:35:18.423822 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: action_args: {'id': '84'} Jun 24 08:35:18.423822 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:35:18.423822 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:35:18.424678 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:18.425763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-658a3fcf-fee1-4651-9ad5-bdde83561f3e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:35:18.426839 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-658a3fcf-fee1-4651-9ad5-bdde83561f3e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062863 Jun 24 08:35:18.426839 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Fri Jun 24 08:35:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:35:18.433561 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-bd8717cc-ef60-4124-8a25-329946ea3700 admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:18.446802 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-bd8717cc-ef60-4124-8a25-329946ea3700 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016864 Jun 24 08:35:18.447368 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Fri Jun 24 08:35:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:35:18.456889 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-1bc3b859-f0fc-4501-b481-677d23e9bc17 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:18.470901 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-1bc3b859-f0fc-4501-b481-677d23e9bc17 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017334 Jun 24 08:35:18.471468 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Fri Jun 24 08:35:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:35:18.480996 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-049b0034-bcac-46c2-baa6-8403e9f52b64 admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:18.486445 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.wsgi [None req-049b0034-bcac-46c2-baa6-8403e9f52b64 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-049b0034-bcac-46c2-baa6-8403e9f52b64 admin admin] Request method failure captured: Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Accept: application/json Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Accept-Encoding: gzip, deflate Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Connection: keep-alive Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Content-Length: 0 Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Host: 10.222.0.43 Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Openstack-Api-Version: compute 2.90 Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Openstack-System-Scope: None Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: User-Agent: python-novaclient Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Auth-Token: gAAAAABitXdG7yEdBoUm2d0WAoqfS6GmIh2S-8adAj3Upjes8UsarEwJraW4UA0AclqplLG--UsWuOL4pPfvmJGD6lORIIzHff6tousZ_UfbxeYyauuXiSrbQyOp_8NS_GtjINP2OdhM2ZuW2i_yX4-igvxUSwyTYmElMHkuGRPkUUn8RU7H8ys Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Domain-Id: None Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Domain-Name: None Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Identity-Status: Confirmed Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Is-Admin-Project: True Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Project-Domain-Id: default Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Project-Domain-Name: Default Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Project-Id: ffa0e0eb99bd42cebd2bc5b9d635fa5d Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Project-Name: admin Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Role: admin,member,reader Jun 24 08:35:18.487997 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Roles: admin,member,reader Jun 24 08:35:18.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ffa0e0eb99bd42cebd2bc5b9d635fa5d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:35:18.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Tenant: admin Jun 24 08:35:18.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Tenant-Id: ffa0e0eb99bd42cebd2bc5b9d635fa5d Jun 24 08:35:18.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Tenant-Name: admin Jun 24 08:35:18.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User: admin Jun 24 08:35:18.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User-Domain-Id: default Jun 24 08:35:18.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User-Domain-Name: Default Jun 24 08:35:18.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User-Id: ca1ff62a97334431beecc4658e2e8e61 Jun 24 08:35:18.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User-Name: admin Jun 24 08:35:18.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: method: > Jun 24 08:35:18.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: exception: Flavor 84 could not be found. Jun 24 08:35:18.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: action_args: {'id': '84'} Jun 24 08:35:18.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:35:18.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:35:18.490476 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:18.491866 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-049b0034-bcac-46c2-baa6-8403e9f52b64 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:35:18.493108 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-049b0034-bcac-46c2-baa6-8403e9f52b64 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012077 Jun 24 08:35:18.493108 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Fri Jun 24 08:35:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 08:35:19.301605 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-1bc3b859-f0fc-4501-b481-677d23e9bc17 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:19.302605 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-1bc3b859-f0fc-4501-b481-677d23e9bc17 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 24 08:35:19.302991 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Jun 24 08:35:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:35:19.489156 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-b7c88cd7-d538-42f8-bd75-ed38d039c66b admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:19.494852 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.wsgi [None req-b7c88cd7-d538-42f8-bd75-ed38d039c66b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-b7c88cd7-d538-42f8-bd75-ed38d039c66b admin admin] Request method failure captured: Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Accept: application/json Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Accept-Encoding: gzip, deflate Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Connection: keep-alive Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Content-Length: 0 Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Host: 10.222.0.43 Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Openstack-Api-Version: compute 2.90 Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Openstack-System-Scope: None Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: User-Agent: python-novaclient Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Auth-Token: gAAAAABitXdHuQiN4ldJ5uM9GdnEQW3u66-RTceCIpUxqqskLtmmyx4MbkUrJM5wDwOOuR9DxngvyL4jRDt5h4gjAkvzBwXJDxAKH2HXR0hwBiTaSb7FnSTUb78PmtyeiFuwXzna1nJx82zH58vEduM7nN6mZRUdns80H8rWb3MdSzw5_dYbq8k Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Domain-Id: None Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Domain-Name: None Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Identity-Status: Confirmed Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Is-Admin-Project: True Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Project-Domain-Id: default Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Project-Domain-Name: Default Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Project-Id: ffa0e0eb99bd42cebd2bc5b9d635fa5d Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Project-Name: admin Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Role: admin,member,reader Jun 24 08:35:19.496387 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Roles: admin,member,reader Jun 24 08:35:19.497746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ffa0e0eb99bd42cebd2bc5b9d635fa5d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:35:19.497746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Tenant: admin Jun 24 08:35:19.497746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Tenant-Id: ffa0e0eb99bd42cebd2bc5b9d635fa5d Jun 24 08:35:19.497746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-Tenant-Name: admin Jun 24 08:35:19.497746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User: admin Jun 24 08:35:19.497746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User-Domain-Id: default Jun 24 08:35:19.497746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User-Domain-Name: Default Jun 24 08:35:19.497746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User-Id: ca1ff62a97334431beecc4658e2e8e61 Jun 24 08:35:19.497746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: X-User-Name: admin Jun 24 08:35:19.497746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: method: > Jun 24 08:35:19.497746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: exception: Flavor 451 could not be found. Jun 24 08:35:19.497746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: action_args: {'id': '451'} Jun 24 08:35:19.497746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:35:19.497746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:35:19.498558 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: ERROR nova.api.openstack.wsgi Jun 24 08:35:19.499674 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-b7c88cd7-d538-42f8-bd75-ed38d039c66b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:35:19.500722 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-b7c88cd7-d538-42f8-bd75-ed38d039c66b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060276 Jun 24 08:35:19.500722 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Fri Jun 24 08:35:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:35:19.507204 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-97c07443-5cc9-4271-8b1d-17b30d357efb admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:19.520515 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-97c07443-5cc9-4271-8b1d-17b30d357efb admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016819 Jun 24 08:35:19.521028 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Fri Jun 24 08:35:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:35:19.530672 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-3977eea4-bea9-4dcb-965a-820d2894bd1a admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:19.543931 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-3977eea4-bea9-4dcb-965a-820d2894bd1a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017480 Jun 24 08:35:19.544438 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Fri Jun 24 08:35:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:35:19.553887 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-c3e015b7-2d2b-4608-a5f9-1bd69478dd16 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:19.558968 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.wsgi [None req-c3e015b7-2d2b-4608-a5f9-1bd69478dd16 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-c3e015b7-2d2b-4608-a5f9-1bd69478dd16 admin admin] Request method failure captured: Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Accept: application/json Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Accept-Encoding: gzip, deflate Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Connection: keep-alive Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Content-Length: 0 Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Host: 10.222.0.43 Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Openstack-Api-Version: compute 2.90 Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Openstack-System-Scope: None Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: User-Agent: python-novaclient Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Auth-Token: gAAAAABitXdHuQiN4ldJ5uM9GdnEQW3u66-RTceCIpUxqqskLtmmyx4MbkUrJM5wDwOOuR9DxngvyL4jRDt5h4gjAkvzBwXJDxAKH2HXR0hwBiTaSb7FnSTUb78PmtyeiFuwXzna1nJx82zH58vEduM7nN6mZRUdns80H8rWb3MdSzw5_dYbq8k Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Domain-Id: None Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Domain-Name: None Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Identity-Status: Confirmed Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Is-Admin-Project: True Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Project-Domain-Id: default Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Project-Domain-Name: Default Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Project-Id: ffa0e0eb99bd42cebd2bc5b9d635fa5d Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Project-Name: admin Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Role: admin,member,reader Jun 24 08:35:19.560493 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Roles: admin,member,reader Jun 24 08:35:19.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ffa0e0eb99bd42cebd2bc5b9d635fa5d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ffa0e0eb99bd42cebd2bc5b9d635fa5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:35:19.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Tenant: admin Jun 24 08:35:19.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Tenant-Id: ffa0e0eb99bd42cebd2bc5b9d635fa5d Jun 24 08:35:19.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-Tenant-Name: admin Jun 24 08:35:19.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User: admin Jun 24 08:35:19.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User-Domain-Id: default Jun 24 08:35:19.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User-Domain-Name: Default Jun 24 08:35:19.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User-Id: ca1ff62a97334431beecc4658e2e8e61 Jun 24 08:35:19.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: X-User-Name: admin Jun 24 08:35:19.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: method: > Jun 24 08:35:19.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: exception: Flavor 451 could not be found. Jun 24 08:35:19.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: action_args: {'id': '451'} Jun 24 08:35:19.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:35:19.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:35:19.562866 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: ERROR nova.api.openstack.wsgi Jun 24 08:35:19.563987 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-c3e015b7-2d2b-4608-a5f9-1bd69478dd16 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:35:19.564993 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-c3e015b7-2d2b-4608-a5f9-1bd69478dd16 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011316 Jun 24 08:35:19.564993 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Fri Jun 24 08:35:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:35:20.364891 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-3977eea4-bea9-4dcb-965a-820d2894bd1a admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:20.365919 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-3977eea4-bea9-4dcb-965a-820d2894bd1a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 24 08:35:20.366299 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Jun 24 08:35:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:35:20.555230 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-fec10599-5821-4e93-add4-6d7a55eecd3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:35:20.572763 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-fec10599-5821-4e93-add4-6d7a55eecd3f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068209 Jun 24 08:35:20.573283 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Fri Jun 24 08:35:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:35:21.387026 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-3977eea4-bea9-4dcb-965a-820d2894bd1a admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:21.388059 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-3977eea4-bea9-4dcb-965a-820d2894bd1a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 24 08:35:21.388447 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Jun 24 08:35:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:35:21.575485 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-1af14938-84c4-4538-87eb-6420fe02742f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:35:21.593527 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-1af14938-84c4-4538-87eb-6420fe02742f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068898 Jun 24 08:35:21.594098 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Fri Jun 24 08:35:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:35:22.406479 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-3977eea4-bea9-4dcb-965a-820d2894bd1a admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:22.407534 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-3977eea4-bea9-4dcb-965a-820d2894bd1a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jun 24 08:35:22.407921 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Jun 24 08:35:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:35:22.595728 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-968e6034-29a7-4b0e-80b9-61e764aad200 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:35:22.613473 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-968e6034-29a7-4b0e-80b9-61e764aad200 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068661 Jun 24 08:35:22.614004 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Fri Jun 24 08:35:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:35:23.425922 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-3977eea4-bea9-4dcb-965a-820d2894bd1a admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:23.426921 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-3977eea4-bea9-4dcb-965a-820d2894bd1a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 24 08:35:23.427343 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Jun 24 08:35:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:35:23.617237 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-f11297b7-d683-4b71-9d48-e1ee7a53effe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:35:23.634876 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-f11297b7-d683-4b71-9d48-e1ee7a53effe admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067972 Jun 24 08:35:23.635440 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Fri Jun 24 08:35:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:35:24.460142 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-3977eea4-bea9-4dcb-965a-820d2894bd1a admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:24.461159 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-3977eea4-bea9-4dcb-965a-820d2894bd1a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 24 08:35:24.461588 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Jun 24 08:35:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:35:24.656480 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-84b49721-c8a4-4566-90eb-e022b797f7e0 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:24.675765 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-84b49721-c8a4-4566-90eb-e022b797f7e0 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078778 Jun 24 08:35:24.676294 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Fri Jun 24 08:35:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:36:11.000781 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-3977eea4-bea9-4dcb-965a-820d2894bd1a admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:11.001786 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-3977eea4-bea9-4dcb-965a-820d2894bd1a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Jun 24 08:36:11.002177 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 930 bytes} [Fri Jun 24 08:36:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:36:11.012648 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG dbcounter [-] [109869] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:11.060386 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-e8422606-27c6-4501-86f2-b4e66d60b30b admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:11.079851 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-e8422606-27c6-4501-86f2-b4e66d60b30b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071745 Jun 24 08:36:11.080380 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1291 bytes} [Fri Jun 24 08:36:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:36:11.103175 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-f7c4da57-5e2a-4410-975f-5e78da4faad1 admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:11.106615 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG dbcounter [-] [109870] Writing DB stats nova_api:SELECT=14 {{(pid=109870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:11.113222 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-f7c4da57-5e2a-4410-975f-5e78da4faad1 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013597 Jun 24 08:36:11.113754 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1282 bytes} [Fri Jun 24 08:36:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:36:11.124973 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-ee496735-ee9e-4537-b335-f5a56e73faa4 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:11.132522 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-ee496735-ee9e-4537-b335-f5a56e73faa4 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011175 Jun 24 08:36:11.133027 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1285 bytes} [Fri Jun 24 08:36:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:36:11.143876 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-b89af928-26f7-42d3-a329-c6c0747ecbb7 admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:11.151595 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-b89af928-26f7-42d3-a329-c6c0747ecbb7 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011084 Jun 24 08:36:11.152124 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1285 bytes} [Fri Jun 24 08:36:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:36:11.163924 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-2379d938-f981-4a9e-a95e-2db79057b627 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:11.172166 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-2379d938-f981-4a9e-a95e-2db79057b627 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011137 Jun 24 08:36:11.172693 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1282 bytes} [Fri Jun 24 08:36:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:39:28.845484 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-b89af928-26f7-42d3-a329-c6c0747ecbb7 admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:39:28.846484 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-b89af928-26f7-42d3-a329-c6c0747ecbb7 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 24 08:39:28.846874 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Jun 24 08:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:39:28.987569 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG dbcounter [-] [109869] Writing DB stats nova_api:SELECT=6 {{(pid=109869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:39:29.100610 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-2bd17e50-e5ba-4b6a-8494-bbe131cbb6d1 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:39:29.101771 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:39:29.101771 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: warnings.warn(msg) Jun 24 08:39:29.102964 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-2bd17e50-e5ba-4b6a-8494-bbe131cbb6d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:39:29.103511 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-2bd17e50-e5ba-4b6a-8494-bbe131cbb6d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:39:29.104299 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-2bd17e50-e5ba-4b6a-8494-bbe131cbb6d1 admin admin] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:39:29.104728 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-2bd17e50-e5ba-4b6a-8494-bbe131cbb6d1 admin admin] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:39:29.138233 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-2bd17e50-e5ba-4b6a-8494-bbe131cbb6d1 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152129 Jun 24 08:39:29.138773 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Fri Jun 24 08:39:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:39:29.973746 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-b89af928-26f7-42d3-a329-c6c0747ecbb7 admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:39:29.974757 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-b89af928-26f7-42d3-a329-c6c0747ecbb7 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 24 08:39:29.975161 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Jun 24 08:39:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:39:30.163895 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-176a7cf1-6a55-47bb-bcf1-1f1009c62b10 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:39:30.165065 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:39:30.165065 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: warnings.warn(msg) Jun 24 08:39:30.166274 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-176a7cf1-6a55-47bb-bcf1-1f1009c62b10 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:39:30.166729 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-176a7cf1-6a55-47bb-bcf1-1f1009c62b10 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:39:30.167558 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-176a7cf1-6a55-47bb-bcf1-1f1009c62b10 admin admin] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:39:30.167984 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-176a7cf1-6a55-47bb-bcf1-1f1009c62b10 admin admin] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:39:30.187749 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-176a7cf1-6a55-47bb-bcf1-1f1009c62b10 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075452 Jun 24 08:39:30.188248 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Fri Jun 24 08:39:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:39:41.412705 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-b89af928-26f7-42d3-a329-c6c0747ecbb7 admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:39:41.413713 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-b89af928-26f7-42d3-a329-c6c0747ecbb7 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 Jun 24 08:39:41.414101 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Jun 24 08:39:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:39:41.557408 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG dbcounter [-] [109869] Writing DB stats nova_cell0:SELECT=4 {{(pid=109869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:39:41.558164 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG dbcounter [-] [109869] Writing DB stats nova_cell1:SELECT=4 {{(pid=109869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:39:41.558838 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG dbcounter [-] [109869] Writing DB stats nova_api:SELECT=8 {{(pid=109869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:39:41.605715 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-f1459727-49a7-4d5b-926b-34b941c78293 admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:39:41.606883 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:39:41.606883 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: warnings.warn(msg) Jun 24 08:39:41.608132 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-f1459727-49a7-4d5b-926b-34b941c78293 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:39:41.608578 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-f1459727-49a7-4d5b-926b-34b941c78293 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:39:41.609398 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-f1459727-49a7-4d5b-926b-34b941c78293 admin admin] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:39:41.609828 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-f1459727-49a7-4d5b-926b-34b941c78293 admin admin] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:39:41.635662 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-f1459727-49a7-4d5b-926b-34b941c78293 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082974 Jun 24 08:39:41.636186 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 38/74] 10.222.0.43 () {60 vars in 1193 bytes} [Fri Jun 24 08:39:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:39:42.463884 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: DEBUG nova.api.openstack.wsgi [None req-b89af928-26f7-42d3-a329-c6c0747ecbb7 admin admin] Calling method '>' {{(pid=109870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:39:42.464895 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: INFO nova.api.openstack.requestlog [None req-b89af928-26f7-42d3-a329-c6c0747ecbb7 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 24 08:39:42.465296 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: [pid: 109870|app: 0|req: 37/75] 10.222.0.43 () {56 vars in 1074 bytes} [Fri Jun 24 08:39:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:39:42.653035 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG nova.api.openstack.wsgi [None req-3bb90956-3323-4441-89c5-e3bb1d130e1f admin admin] Calling method '>' {{(pid=109869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:39:42.654196 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:39:42.654196 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: warnings.warn(msg) Jun 24 08:39:42.655420 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-3bb90956-3323-4441-89c5-e3bb1d130e1f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:39:42.655860 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-3bb90956-3323-4441-89c5-e3bb1d130e1f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:39:42.656649 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-3bb90956-3323-4441-89c5-e3bb1d130e1f admin admin] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:39:42.657074 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: DEBUG oslo_concurrency.lockutils [None req-3bb90956-3323-4441-89c5-e3bb1d130e1f admin admin] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:39:42.679774 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: INFO nova.api.openstack.requestlog [None req-3bb90956-3323-4441-89c5-e3bb1d130e1f admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077415 Jun 24 08:39:42.680320 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: [pid: 109869|app: 0|req: 39/76] 10.222.0.43 () {60 vars in 1193 bytes} [Fri Jun 24 08:39:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:40:43.194863 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: Fri Jun 24 08:40:43 2022 - graceful shutdown triggered... Jun 24 08:40:43.195411 dv-cinder-845178-9-iscsi devstack@n-api.service[109870]: Gracefully killing worker 2 (pid: 109870)... Jun 24 08:40:43.195797 dv-cinder-845178-9-iscsi devstack@n-api.service[109869]: Gracefully killing worker 1 (pid: 109869)... Jun 24 08:40:43.198833 dv-cinder-845178-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 24 08:40:44.195342 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: worker 1 buried after 1 seconds Jun 24 08:40:44.195783 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: worker 2 buried after 1 seconds Jun 24 08:40:44.195783 dv-cinder-845178-9-iscsi devstack@n-api.service[109868]: goodbye to uWSGI. Jun 24 08:40:44.196895 dv-cinder-845178-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 24 08:40:44.197434 dv-cinder-845178-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 24 08:40:44.200241 dv-cinder-845178-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 08:40:44.210058 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 08:40:44.212701 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 08:40:44 2022] *** Jun 24 08:40:44.212701 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 08:40:44.212701 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 08:40:44.212701 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: nodename: dv-cinder-845178-9-iscsi Jun 24 08:40:44.212701 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: machine: x86_64 Jun 24 08:40:44.212701 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: clock source: unix Jun 24 08:40:44.212701 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: pcre jit disabled Jun 24 08:40:44.212701 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: detected number of CPU cores: 4 Jun 24 08:40:44.212701 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: current working directory: / Jun 24 08:40:44.212701 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: detected binary path: /usr/bin/uwsgi-core Jun 24 08:40:44.213410 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: your processes number limit is 47680 Jun 24 08:40:44.213410 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: your memory page size is 4096 bytes Jun 24 08:40:44.213410 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: detected max file descriptor number: 2048 Jun 24 08:40:44.213410 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: lock engine: pthread robust mutexes Jun 24 08:40:44.213410 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: thunder lock: enabled Jun 24 08:40:44.213410 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 08:40:44.213410 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 08:40:44.257380 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: Python main interpreter initialized at 0x55b1836899c0 Jun 24 08:40:44.257380 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: python threads support enabled Jun 24 08:40:44.257380 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: your server socket listen backlog is limited to 100 connections Jun 24 08:40:44.257380 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: your mercy for graceful operations on workers is 90 seconds Jun 24 08:40:44.257832 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 08:40:44.257832 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: *** Operational MODE: preforking *** Jun 24 08:40:44.258098 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: *** uWSGI is running in multiple interpreter mode *** Jun 24 08:40:44.258098 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: spawned uWSGI master process (pid: 124361) Jun 24 08:40:44.258302 dv-cinder-845178-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 08:40:44.259013 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: spawned uWSGI worker 1 (pid: 124379, cores: 1) Jun 24 08:40:44.259246 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: spawned uWSGI worker 2 (pid: 124380, cores: 1) Jun 24 08:40:44.259548 dv-cinder-845178-9-iscsi devstack@n-api.service[124361]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 08:40:44.917276 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:40:44.921284 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:40:46.124635 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:40:46.124635 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: from cryptography.utils import int_from_bytes Jun 24 08:40:46.125302 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:40:46.125302 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: from cryptography.utils import int_from_bytes Jun 24 08:40:46.136393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:40:46.136393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: from cryptography.utils import int_from_bytes Jun 24 08:40:46.136913 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:40:46.136913 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: from cryptography.utils import int_from_bytes Jun 24 08:40:48.513814 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:40:48.514384 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:40:48.514504 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:40:48.514865 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:40:48.515121 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:40:48.515532 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.515872 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.516186 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.516502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.516836 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.517147 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.517467 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.517782 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.518107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.518367 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.518678 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.519000 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-9-iscsi {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.519353 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.519664 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.519972 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.520296 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.520594 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.520948 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.521253 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.521803 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.523294 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.523294 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.523294 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.523294 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.523654 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.523880 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.524132 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.524453 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.524778 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.525085 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.525507 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-9-iscsi {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.525809 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.526105 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.526425 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.526856 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.527163 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.527511 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.527811 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.528144 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.528466 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.528779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.529096 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.529413 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.529727 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.530029 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.530350 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.530644 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.530961 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.531288 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.531598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.531887 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.532147 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.532469 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.532789 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.533109 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.533360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.533611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.533930 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.534249 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.534554 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.534862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.535170 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.535504 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.535805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.536109 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.536413 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.537250 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.537367 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:40:48.537781 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:40:48.537867 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.537867 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.538110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:40:48.538220 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.538404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:40:48.538504 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.538939 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:40:48.539108 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.539349 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.539522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.539667 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.539808 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.539950 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.540100 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.540287 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.540473 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.540630 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.540780 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.540943 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.541113 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.541282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.541440 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.541600 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.541753 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.541896 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.542037 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.542189 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.542347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.542499 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.542652 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.542809 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.542959 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-9-iscsi {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.543147 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.543333 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.543490 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.543634 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.543783 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.543937 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.544093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.544235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.544384 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.544535 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.544686 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.544829 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.544993 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.545136 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.545278 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.545430 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.545574 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.545750 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.545917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.546069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.546218 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.546360 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.546504 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.546666 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.546816 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.547017 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.547164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.547351 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.547513 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.548355 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.548518 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.548663 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.548805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.548947 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.549103 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.549252 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.549407 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.549407 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.549696 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.549847 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.550002 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-9-iscsi {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.550201 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.550352 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.550501 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.550644 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.550800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.550942 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.551083 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.551256 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.551429 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.551580 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.551731 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.551882 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.552031 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.552825 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.552980 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.553131 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.553282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.553426 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.553583 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.553583 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.553855 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.554009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.554158 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.554301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.554452 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.554595 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.554744 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.554894 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.555044 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.555194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.555399 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.555550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.555703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.555872 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.556028 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.556180 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.556338 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.556482 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.556630 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.556773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.556915 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.557068 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.557221 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.557412 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.557567 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.557736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.558599 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.558768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.558920 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.559076 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.559248 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.559411 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.559560 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.559720 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.559871 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.560014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.560157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.560319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.560471 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.560614 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.560756 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.560898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.561040 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.561182 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.561334 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.561477 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.561626 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.561768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.561910 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.562059 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.562222 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.562373 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.562516 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.562658 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.562800 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.562950 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.563103 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.563290 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.563451 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.563603 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.563753 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.563980 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.564124 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.564283 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.564427 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.564576 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.567143 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.567382 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.567540 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.567689 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.567877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.568744 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.568911 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.569221 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.569378 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.569530 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.569676 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.569832 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.569986 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.570138 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.570281 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.570422 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.570564 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.570721 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.570872 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.571022 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.571165 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.571343 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.571487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.571643 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.571795 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.571939 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.572088 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.572236 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.572379 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.572534 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.572688 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.572841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.572990 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.573132 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.573294 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.573443 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.573585 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.573726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.573868 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.574023 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.574181 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.574323 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.574466 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.574613 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.574763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.574913 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.575066 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.575294 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.575454 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.575598 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.575747 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.575905 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.576062 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.576205 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.576346 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.576488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.576637 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.576793 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.576946 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.577098 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.577903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.578069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.578510 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.579193 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.579377 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.579522 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.579613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.579697 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.579782 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.579876 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.579969 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.579969 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.580136 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.580229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.580320 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.580404 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.580487 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.580571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.580667 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.580767 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.580861 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.580947 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.581040 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.581133 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.581217 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.581314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.581405 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.581497 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.581589 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.581680 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.581771 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.581867 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.581972 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.582061 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.582061 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.582200 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.582200 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.582200 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.582405 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.582477 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.582548 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.582619 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.582619 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.582777 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.582870 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.582956 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.583046 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.583130 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.583237 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.583358 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.583455 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.583547 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.583638 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.583731 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.583829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.583924 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.584017 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.584102 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.584185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.584279 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.584377 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.584463 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.584557 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.584643 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.584726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:40:48.584726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.584726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.584726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.584726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.585099 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.585099 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.585428 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.585752 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.586076 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.586411 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.586749 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.587071 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.587813 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.587930 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.587930 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.588104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.588199 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.588532 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.588641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.588979 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.589095 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.589391 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.589391 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.589568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.589655 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.589918 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.590161 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.590254 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.590565 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.590743 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.590883 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.591424 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.591547 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.591644 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.591841 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.592020 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.592245 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.592435 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.592573 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.592892 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.592995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.593209 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.593469 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.593569 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.593841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.594031 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.594182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.594503 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.594594 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.594826 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.595073 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.595171 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.595482 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.595687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.595787 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.596110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.596237 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.596428 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.596724 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.596824 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.597097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.597279 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.597419 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.597737 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.597828 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.598057 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.598320 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.598419 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.598739 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.599678 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.599790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.599877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.600013 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.600119 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.600414 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.600605 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.600733 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.601046 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.601177 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.601376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.601675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.601787 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.602035 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.602253 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.602399 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.602711 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.602866 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.603030 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.603384 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.603506 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.603703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.604005 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.604106 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.604325 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.604608 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.604709 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.604940 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.605195 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.605297 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.605579 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.605801 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.605900 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.606217 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.606375 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.606531 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.606847 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.606946 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.607167 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.607596 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.607701 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.607844 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.608023 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.608149 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.608505 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.608602 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.608920 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.609109 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.609222 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.609490 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.609829 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.609940 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.610173 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.610282 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.610488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.610763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.610865 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.611144 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.611381 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.611478 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.611795 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.611967 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.612127 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.612440 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.612545 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.612752 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.613042 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.613135 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.613367 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.613623 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.613716 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.613971 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.614203 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.614304 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.614593 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.615387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.615550 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.615891 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.615990 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.616208 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.616488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.616594 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.616818 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.617093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.617186 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.617472 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.617666 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.617789 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.618142 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.618240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.618485 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.618728 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.618851 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.619160 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.619347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.619459 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.619781 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.620069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.620177 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.620383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.620477 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.620699 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.620963 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.621062 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.621332 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.621543 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.621636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.621965 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.622133 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.622282 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.622613 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.622713 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.622929 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.623233 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.623333 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.623610 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.623802 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.623971 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.624310 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.624412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.624649 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.624895 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.624995 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.625291 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.625476 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.625609 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.625937 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.626042 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.626252 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.626568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.626665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.626898 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.627143 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.627266 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.627585 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.627752 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.627929 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.628259 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.628359 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.628587 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.628836 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.628929 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.629231 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.629454 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.629568 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.629887 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.629991 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.630293 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.630498 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.630593 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.630840 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.631070 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.631174 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.631493 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.631671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.631949 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.632141 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.632235 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.632481 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.632742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.632842 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.633127 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.633314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.633923 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.634032 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.634128 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.634128 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.634367 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.634503 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.634700 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.635016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.635170 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.635578 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.635701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.635791 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.636070 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.636172 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.636469 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.636648 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.636797 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.637133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.637239 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.637455 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.637734 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.637841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.638110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.638325 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.638426 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.638747 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.638912 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.639340 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.639451 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.639568 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.639791 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.640003 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.640116 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.640420 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.640576 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.640771 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.641085 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.641180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.641400 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.641649 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.641741 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.642079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.642195 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.642358 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.642683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.642784 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.643001 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.643331 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.643442 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.643666 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.643913 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.644006 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.644340 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.644463 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.644703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.644972 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.645075 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.645395 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.645568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.645743 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.646533 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.646690 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.646798 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.646891 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.646891 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.647120 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.647248 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.647996 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.648093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.648198 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.648288 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.648394 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.648758 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.649021 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.649296 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.649585 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.649753 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.649860 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.650160 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.650321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.650543 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.650837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.650951 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.651229 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.651529 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.651637 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.651999 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.652271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.652489 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.652662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.652756 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.653026 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.653132 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.653385 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.653571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.653745 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.654003 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.654097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.654390 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.654483 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.654705 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.654907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.655027 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.655379 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.655631 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.655727 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.655974 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.656073 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.656299 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.656399 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.656630 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.656724 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.656960 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.657053 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.657278 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.657382 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.657592 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.657685 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.657927 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.658021 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.658248 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.658351 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.658562 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.658705 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.658873 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.658980 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.659184 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.659288 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.659523 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.659659 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.659842 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.659953 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.660153 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.660253 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.660463 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.660558 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.660771 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.660902 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.661092 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.661202 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.661404 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.662032 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.662258 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.662369 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.662550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.662665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.662857 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.662951 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.663173 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.663291 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.663507 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.663864 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.664077 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.664186 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.664385 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.664521 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.664713 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.664840 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.665026 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.665159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.665332 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.665474 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.665638 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.665813 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.665943 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.666123 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.666287 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.666443 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.666595 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.666752 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.666936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.667076 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.667317 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.667431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.667633 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.667726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.667941 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.668057 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.668247 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.668346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.668571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.668663 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.668874 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.668976 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.669179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.669273 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.669482 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.669609 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.669845 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.669948 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.670084 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.670199 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.670400 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.670504 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.670689 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.670823 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.670997 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.671183 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.671324 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.671531 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.671855 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.672209 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.672410 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.672526 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.672833 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.673029 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.673195 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.673357 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.673512 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.673663 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.673813 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.674037 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.674200 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.674358 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.674518 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.674661 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.674806 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.675103 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.675449 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.675596 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.675759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.675934 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.676075 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.676258 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.676385 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.676707 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.676809 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.677013 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.677129 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.677894 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.678187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.678475 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.678585 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.678672 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.678915 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.679028 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.679124 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.679388 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.679485 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.679711 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.679846 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.680032 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.680139 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.680341 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.680454 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.680655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.680761 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.681049 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.681183 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.681269 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.681351 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.681564 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.681664 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.681888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.681982 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.682206 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.682299 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.682531 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.682622 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.682831 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.682961 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.683138 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.683285 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.683470 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.683583 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.683777 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.683881 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.684090 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.684195 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.684396 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.684532 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.684704 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.684861 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.685002 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.685156 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.685299 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.685449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.685592 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.685734 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.685896 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.686044 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.686205 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.686355 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.686504 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.686653 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.686796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.686947 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.687111 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.687270 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.687433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.687594 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.687739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.687922 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.688100 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.688239 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.688409 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.688571 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.688724 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.688903 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.689043 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.689215 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.689359 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.689536 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.689701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.689843 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.689993 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.690220 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.690371 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.690515 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.690693 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.690833 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.690971 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.691114 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.691347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.691461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.691550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.691712 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.691806 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.692035 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.692136 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.692360 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.692454 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.692670 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.692786 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.693020 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.693126 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.693341 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.693443 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.693655 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.693746 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.693957 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.694055 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.694265 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.694359 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.694575 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.694667 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.694884 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.694985 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.695194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.695319 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.695527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.695633 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.695839 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.695943 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.696153 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.696285 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.696466 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.696613 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.696780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.696936 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.697094 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.697250 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.697402 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.697569 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.697711 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.697890 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.698022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.698215 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.698316 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.698536 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.698648 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.698848 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.698942 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.699248 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.699358 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.699565 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.699669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.699869 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.699966 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.700179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.700285 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.700483 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.700582 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.700830 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.700939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.701149 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.701250 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.701484 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.701592 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.701798 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.701892 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.702121 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.702227 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.702419 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.702520 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.702733 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.702828 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.703051 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.703187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.703391 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.703487 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.703796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.703905 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.704109 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.704222 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.704421 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.704535 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.704734 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.704882 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.705037 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.705201 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.705341 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.705524 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.705640 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.705859 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.705973 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.706193 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.706309 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.706535 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.706638 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.706838 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.706931 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.707158 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.707285 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.707487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.707580 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.707813 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.707907 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.708147 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.708241 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.708497 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.708594 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.708823 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.708917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.709139 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.709249 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.709471 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.709566 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.709803 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.709898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.710125 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.710233 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.710461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.710567 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.710782 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.710876 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.711089 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.711194 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.711424 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.711534 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.711739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.711843 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.712065 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.712179 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.712389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.712503 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.712701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.712804 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.713019 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.713126 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.713322 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.713432 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.713645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.713747 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.713967 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.714069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.714280 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.714384 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.714602 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.714696 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.714924 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.715032 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.715263 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.715387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.715588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.715703 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.715911 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.716009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.716245 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.716340 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.716565 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.716658 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.716881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.716973 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.717192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.717294 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.717497 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.717591 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.717802 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.717904 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.718126 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.718221 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.718433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.718528 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.718747 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.718855 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.719058 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.719158 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.719392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.719516 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.719699 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.719801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.720006 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.720111 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.720330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.720440 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.720634 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.720744 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.720957 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.721060 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.721267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.721362 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.721595 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.721699 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.721925 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.722039 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.722244 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.722346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.722568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.722665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.722879 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.722980 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.723184 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.723321 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.723521 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.723624 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.723824 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.723920 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.724703 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.724804 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.725011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.725105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.725334 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.725441 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.725644 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.725736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.725969 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.726070 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.726281 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.726384 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.726598 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.726769 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.726913 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.727008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.727265 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.727364 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.727576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.727683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.727901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.727994 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.728209 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.728303 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.728514 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.728623 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.728824 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.728924 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.729127 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.729219 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.729433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.729537 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.729741 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.729842 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.730054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.730152 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.730361 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.730460 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.730666 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.730760 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.730996 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.731109 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.731320 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.731435 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.731633 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.731728 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.731956 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.732058 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.732267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.732368 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.732572 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.732684 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.732876 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.732971 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.733181 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.733289 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.733524 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.733625 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.733829 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.733932 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.734163 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.734264 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.734479 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.734576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.734800 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.734907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.735126 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.735256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.735460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.735718 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.735812 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.736061 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.736164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.736389 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.736491 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.736703 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.736794 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.737017 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.737119 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.737332 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.737426 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.737648 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.737755 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.737961 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.738062 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.738271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.738364 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.738588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.738694 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.738901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.738992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.739232 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.739341 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.739592 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.740335 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.740538 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.740667 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.740884 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.740981 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.741210 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.741310 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.741537 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.741633 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.741864 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.741966 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.742188 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.742300 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.742503 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.742593 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.742815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.742917 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.743127 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.743249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.743482 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.743582 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.743812 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.743919 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.744133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.744227 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.744456 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.744558 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.744777 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.744887 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.745092 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.745193 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.745409 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.745503 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.745727 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.745832 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.746044 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.746138 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.746364 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.746467 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.746691 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.746787 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.746998 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.747091 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.747336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.747446 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.747656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.747758 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.747970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.748064 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.748283 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.748385 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.748595 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.748689 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.748909 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.749133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.749228 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.749458 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.749561 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.749801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.749896 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.750115 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.750208 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.750427 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.750518 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.750753 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.750857 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.751084 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.751176 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.751438 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.751533 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.751753 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.751846 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.752065 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.752167 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.752384 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.752476 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.752703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.752905 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.753005 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.753222 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.753337 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.753589 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.753689 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.753884 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.753979 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.754211 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.754312 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.754530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.754624 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.754848 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.755099 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.755226 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.755515 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.755610 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.755829 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.755930 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.756141 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.756244 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.756453 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.756546 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.756760 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.756860 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.757083 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.757186 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.757394 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.757495 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.757699 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.757800 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.758019 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.758113 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.758329 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.758424 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.758666 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.758869 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.758971 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.759235 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.759333 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.759582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.759678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.759916 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.760009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.760228 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.760322 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.760546 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.760637 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.760856 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.760956 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.761186 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.761280 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.761498 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.761592 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.761805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.761898 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.762117 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.762210 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.762428 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.762527 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.762735 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.762824 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.763042 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.763135 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.763377 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.763485 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.763698 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.763871 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.763978 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.764077 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.764297 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.764416 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.764600 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.764696 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.764908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.765000 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.765225 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.765327 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.765534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.765635 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.765844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.765956 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.766156 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.766250 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.766461 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.766553 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.766767 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.766860 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.767072 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.767166 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.767419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.767512 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.767735 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.767841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.768040 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.768135 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.768351 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.768451 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.768657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.768757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.768968 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.769069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.769274 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.769374 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.769583 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.769903 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.769998 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.770248 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.770341 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.770550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.770641 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.770882 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.770991 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.771196 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.771324 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.771546 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.771644 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.771861 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.771962 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.772175 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.772269 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.772488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.772603 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.772823 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.772913 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.773129 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.773221 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.773448 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.773668 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.773812 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.774009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.774122 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.774333 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.774445 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.774667 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.774764 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.774982 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.775075 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.775323 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.775433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.775631 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.775725 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.775937 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.776062 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.776258 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.776363 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.776566 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.776677 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.776877 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.776969 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.777189 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.777297 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.777502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.777595 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.777812 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.777911 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.778122 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.778228 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.778433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.778534 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.778743 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.778849 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.779055 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.779168 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.779390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.779493 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.779703 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.779804 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.780014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.780115 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.780326 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.780426 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.780642 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.780735 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.780984 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.781073 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.781305 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.781576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.781669 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.781907 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.782024 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.782241 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.782339 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.782553 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.782646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.782865 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.783058 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.783163 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.783456 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.783563 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.783807 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.783944 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.784138 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.784245 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.784451 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.784569 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.784756 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.784953 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.785257 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.785359 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.785573 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.785689 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.785893 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.786036 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.786216 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.786410 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.787091 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.787292 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.787472 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.787638 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.787742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.787976 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.788079 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.788317 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.788427 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.788890 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.788988 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.789224 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.789325 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.789580 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.789701 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.789892 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.789989 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.790221 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.790325 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.790530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.790634 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.790838 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.790964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.791152 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.791304 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.791474 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.791571 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.791800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.791924 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.792121 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.792227 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.792428 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.792540 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.792736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.792870 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.793046 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.793210 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.793351 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.793541 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.793644 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.793861 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.794031 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.794196 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.794335 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.794477 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.794618 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.794764 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.794919 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.795074 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.795248 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.795400 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.795511 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.795744 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.795837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.796077 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.796245 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.796395 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.796547 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.796691 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.796843 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.796993 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.797139 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.797289 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.797494 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.797648 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.797804 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.797953 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.798096 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.798249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.798393 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.798544 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.798698 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.798848 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.799018 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.799204 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.799366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.799563 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.799668 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.799926 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.800029 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.800267 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.800364 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.800593 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.800695 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.800914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.801009 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.801265 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.801382 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.801737 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.801828 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.801930 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.802018 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.802207 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.802823 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.803026 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.803133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.803380 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.803497 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.803691 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.803800 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.804004 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.804165 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.804321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.804483 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.804636 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.804789 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.804951 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.805097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.805241 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.805386 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.805538 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.805693 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.805837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.805995 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.806140 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.806358 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.806523 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.806672 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.806836 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.806988 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.807139 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.807342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.807496 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.807651 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.807796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.807983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.808128 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.808280 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.808437 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.808581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.808743 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.808887 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.809036 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.809176 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.809330 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.809487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.809639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.809816 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.809964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.810116 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.810265 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.810438 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.810586 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.810763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.810909 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.811106 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.811283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.811465 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.811592 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.811739 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:40:48.811835 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.812130 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.812444 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.812757 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.813064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:40:48.813302 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:40:48.874514 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO dbcounter [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] Registered counter for database nova_api Jun 24 08:40:48.875033 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO dbcounter [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] Registered counter for database nova_api Jun 24 08:40:48.894876 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_db.sqlalchemy.engines [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:40:48.896972 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_db.sqlalchemy.engines [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:40:48.902212 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writer thread running {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:40:48.903598 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writer thread running {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:40:48.960767 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.context [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3f4411ef-81df-4f69-8e58-a68a240933fd(cell1) {{(pid=124379) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:40:48.961169 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.context [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3f4411ef-81df-4f69-8e58-a68a240933fd(cell1) {{(pid=124380) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:40:48.964923 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:40:48.965257 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:40:48.966550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:40:48.966890 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:40:48.967389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:40:48.967734 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:40:48.969398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:40:48.969710 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:40:48.971410 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO dbcounter [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] Registered counter for database nova_cell0 Jun 24 08:40:48.971731 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO dbcounter [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] Registered counter for database nova_cell0 Jun 24 08:40:48.975639 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO dbcounter [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] Registered counter for database nova_cell1 Jun 24 08:40:48.975756 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO dbcounter [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] Registered counter for database nova_cell1 Jun 24 08:40:48.982973 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_db.sqlalchemy.engines [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:40:48.984778 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_db.sqlalchemy.engines [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:40:48.985917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_db.sqlalchemy.engines [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:40:48.987829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_db.sqlalchemy.engines [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:40:48.991988 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writer thread running {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:40:48.993316 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writer thread running {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:40:48.993692 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writer thread running {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:40:48.995340 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writer thread running {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:40:49.144259 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO dbcounter [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] Registered counter for database nova_cell0 Jun 24 08:40:49.151168 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO dbcounter [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] Registered counter for database nova_cell0 Jun 24 08:40:49.151572 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_db.sqlalchemy.engines [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:40:49.156209 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writer thread running {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:40:49.158588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_db.sqlalchemy.engines [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:40:49.164040 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writer thread running {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:40:49.483301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: WARNING keystonemiddleware.auth_token [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:40:49.489568 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: WARNING keystonemiddleware.auth_token [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:40:49.491257 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: WARNING keystonemiddleware.auth_token [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:40:49.497452 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: WARNING keystonemiddleware.auth_token [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:40:49.839111 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: WARNING keystonemiddleware.auth_token [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:40:49.845080 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: WARNING keystonemiddleware.auth_token [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:40:49.845494 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: WARNING keystonemiddleware.auth_token [None req-4de0d98b-b0df-45dd-881e-5269eb2c15df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:40:49.850633 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b1836899c0 pid: 124379 (default app) Jun 24 08:40:49.851092 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: WARNING keystonemiddleware.auth_token [None req-0762d7a8-0502-4fcf-ae5c-29760032d423 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:40:49.856453 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b1836899c0 pid: 124380 (default app) Jun 24 08:41:30.091591 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:30.092446 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:30.093179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:30.093894 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:30.426801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:30.428655 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:30.429643 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:30.430880 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:31.835823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-fc11a102-1a09-4eab-8223-32b510318cbf tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Action: 'create', calling method: .version_select at 0x7fb75e8e1700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-504588583", "metadata": {"Type": "work"}}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-fc11a102-1a09-4eab-8223-32b510318cbf tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Request method failure captured: Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 121 Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXi5vL8_n5vRVRJ3wFMW2KuKxLb4GB33iOL8WbWIcqTQ4w1qfwu4AAjHqJGYFDeGOEXqeVzJyDVe2hXT3r9R2poUvbKJjFelb0auLHWF4TjPN9kagrxRSluajKS3MwPpK9uAuEhg28RkqJuTtPHoDByVTyNFN4BulqjU2onpCy1BzZs Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 720fe6eaea524e23b60da4aa4a4973e3 Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:41:31.863064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:41:31.864687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_720fe6eaea524e23b60da4aa4a4973e3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:41:31.864687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:31.864687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 720fe6eaea524e23b60da4aa4a4973e3 Jun 24 08:41:31.864687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:31.864687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesNegativeTest-777821456-project Jun 24 08:41:31.864687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:41:31.864687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:41:31.864687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 18303519eb03426ba068c044a352775d Jun 24 08:41:31.864687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesNegativeTest-777821456-project Jun 24 08:41:31.864687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Jun 24 08:41:31.864687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-504588583", "metadata": {"Type": "work"}}} Jun 24 08:41:31.864687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: Jun 24 08:41:31.864687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-504588583', 'metadata': {'Type': 'work'}}}} Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise error Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi '#$%' Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:41:31.865559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 08:41:31.867011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 08:41:31.869886 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 08:41:31.869886 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.871635 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-fc11a102-1a09-4eab-8223-32b510318cbf tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:41:31.872861 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-fc11a102-1a09-4eab-8223-32b510318cbf tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.794275 Jun 24 08:41:31.878226 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1155 bytes} [Fri Jun 24 08:41:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1797 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:41:31.886993 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8300b39c-d5ee-4e92-8f60-f938ec2c57d5 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Action: 'create', calling method: .version_select at 0x7fb75e8609d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1386340897", "metadata": {"Type": "work"}}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8300b39c-d5ee-4e92-8f60-f938ec2c57d5 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Request method failure captured: Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 120 Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXi5vL8_n5vRVRJ3wFMW2KuKxLb4GB33iOL8WbWIcqTQ4w1qfwu4AAjHqJGYFDeGOEXqeVzJyDVe2hXT3r9R2poUvbKJjFelb0auLHWF4TjPN9kagrxRSluajKS3MwPpK9uAuEhg28RkqJuTtPHoDByVTyNFN4BulqjU2onpCy1BzZs Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 720fe6eaea524e23b60da4aa4a4973e3 Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:41:31.902057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:41:31.903314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_720fe6eaea524e23b60da4aa4a4973e3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:41:31.903314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:31.903314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 720fe6eaea524e23b60da4aa4a4973e3 Jun 24 08:41:31.903314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:31.903314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesNegativeTest-777821456-project Jun 24 08:41:31.903314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:41:31.903314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:41:31.903314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 18303519eb03426ba068c044a352775d Jun 24 08:41:31.903314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesNegativeTest-777821456-project Jun 24 08:41:31.903314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Jun 24 08:41:31.903314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1386340897", "metadata": {"Type": "work"}}} Jun 24 08:41:31.903314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: Jun 24 08:41:31.903314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1386340897', 'metadata': {'Type': 'work'}}}} Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise error Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi '0' Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:41:31.904107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 08:41:31.905388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 08:41:31.906493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 08:41:31.906493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.906493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8300b39c-d5ee-4e92-8f60-f938ec2c57d5 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:41:31.913039 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8300b39c-d5ee-4e92-8f60-f938ec2c57d5 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023593 Jun 24 08:41:31.913039 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 2/2] 10.222.0.43 () {60 vars in 1155 bytes} [Fri Jun 24 08:41:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:41:31.925391 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c23083b4-6fab-4371-9506-3dcf6c5316dc tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Action: 'create', calling method: .version_select at 0x7fb75e8e1a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1716345876", "metadata": {"Type": "work"}}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c23083b4-6fab-4371-9506-3dcf6c5316dc tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Request method failure captured: Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 119 Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXi5vL8_n5vRVRJ3wFMW2KuKxLb4GB33iOL8WbWIcqTQ4w1qfwu4AAjHqJGYFDeGOEXqeVzJyDVe2hXT3r9R2poUvbKJjFelb0auLHWF4TjPN9kagrxRSluajKS3MwPpK9uAuEhg28RkqJuTtPHoDByVTyNFN4BulqjU2onpCy1BzZs Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 720fe6eaea524e23b60da4aa4a4973e3 Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:41:31.933256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:41:31.934551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_720fe6eaea524e23b60da4aa4a4973e3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:41:31.934551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:31.934551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 720fe6eaea524e23b60da4aa4a4973e3 Jun 24 08:41:31.934551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:31.934551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesNegativeTest-777821456-project Jun 24 08:41:31.934551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:41:31.934551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:41:31.934551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 18303519eb03426ba068c044a352775d Jun 24 08:41:31.934551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesNegativeTest-777821456-project Jun 24 08:41:31.934551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Jun 24 08:41:31.934551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1716345876", "metadata": {"Type": "work"}}} Jun 24 08:41:31.934551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: Jun 24 08:41:31.934551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1716345876', 'metadata': {'Type': 'work'}}}} Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise error Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi '' Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:41:31.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 08:41:31.936675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 08:41:31.937839 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 08:41:31.937839 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:31.937839 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c23083b4-6fab-4371-9506-3dcf6c5316dc tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:41:31.938381 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c23083b4-6fab-4371-9506-3dcf6c5316dc tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021952 Jun 24 08:41:31.939491 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 3/3] 10.222.0.43 () {60 vars in 1155 bytes} [Fri Jun 24 08:41:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:41:31.952015 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-21cb0f56-557a-4198-bcc4-8020a0a836e5 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Calling method '.version_select at 0x7fb75e78a670>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:32.019255 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d3d40769-aca3-4307-9919-f4427686e47a tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Action: 'create', calling method: .version_select at 0x7fb75e8dc790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1334760253"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:33.175471 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-21cb0f56-557a-4198-bcc4-8020a0a836e5 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] HTTP exception thrown: Volume tempest-invalid-49352961 could not be found. Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-21cb0f56-557a-4198-bcc4-8020a0a836e5 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Request method failure captured: Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-49352961 HTTP/1.1 Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXi5vL8_n5vRVRJ3wFMW2KuKxLb4GB33iOL8WbWIcqTQ4w1qfwu4AAjHqJGYFDeGOEXqeVzJyDVe2hXT3r9R2poUvbKJjFelb0auLHWF4TjPN9kagrxRSluajKS3MwPpK9uAuEhg28RkqJuTtPHoDByVTyNFN4BulqjU2onpCy1BzZs Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 720fe6eaea524e23b60da4aa4a4973e3 Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:41:33.183522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:41:33.184815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_720fe6eaea524e23b60da4aa4a4973e3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:41:33.184815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:33.184815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 720fe6eaea524e23b60da4aa4a4973e3 Jun 24 08:41:33.184815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:33.184815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesNegativeTest-777821456-project Jun 24 08:41:33.184815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:41:33.184815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:41:33.184815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 18303519eb03426ba068c044a352775d Jun 24 08:41:33.184815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesNegativeTest-777821456-project Jun 24 08:41:33.184815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: Jun 24 08:41:33.184815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Volume tempest-invalid-49352961 could not be found. Jun 24 08:41:33.184815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': 'tempest-invalid-49352961'} Jun 24 08:41:33.184815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:41:33.184815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-49352961 could not be found. (HTTP 404) (Request-ID: req-31a50350-747f-4e20-8f09-19f8d888a61b) Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.186063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:41:33.187295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-49352961 could not be found. Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:41:33.188582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-49352961 could not be found. Jun 24 08:41:33.189742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.189742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:33.189742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.189742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:33.189742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:33.189742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:33.189742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:41:33.189742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:41:33.189742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-49352961 could not be found. Jun 24 08:41:33.189742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.229512 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-21cb0f56-557a-4198-bcc4-8020a0a836e5 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Returning 404 to user: Volume tempest-invalid-49352961 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:41:33.230474 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-21cb0f56-557a-4198-bcc4-8020a0a836e5 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-49352961" status: 404 len: 97 microversion: 2.1 time: 1.285286 Jun 24 08:41:33.231037 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 4/4] 10.222.0.43 () {58 vars in 1211 bytes} [Fri Jun 24 08:41:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-49352961 => generated 97 bytes in 1287 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 24 08:41:33.246568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-76d59f37-eac1-40dc-943e-723d9ec49c47 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008003 Jun 24 08:41:33.252733 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 5/5] 10.222.0.43 () {58 vars in 1139 bytes} [Fri Jun 24 08:41:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 08:41:33.260489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-298082b7-90c8-4ec7-b950-d8f1e5b7817f tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006664 Jun 24 08:41:33.272490 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 6/6] 10.222.0.43 () {58 vars in 1136 bytes} [Fri Jun 24 08:41:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 08:41:33.281578 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b0964a08-efa8-4c4f-9360-3c9a389dfa16 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Calling method '.version_select at 0x7fb75e73ba60>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:33.481398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-b0964a08-efa8-4c4f-9360-3c9a389dfa16 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] HTTP exception thrown: Volume a19a2ee9-6a94-46e4-84d5-4f23edbd3286 could not be found. Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b0964a08-efa8-4c4f-9360-3c9a389dfa16 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Request method failure captured: Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/os-volumes/a19a2ee9-6a94-46e4-84d5-4f23edbd3286 HTTP/1.1 Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXi5vL8_n5vRVRJ3wFMW2KuKxLb4GB33iOL8WbWIcqTQ4w1qfwu4AAjHqJGYFDeGOEXqeVzJyDVe2hXT3r9R2poUvbKJjFelb0auLHWF4TjPN9kagrxRSluajKS3MwPpK9uAuEhg28RkqJuTtPHoDByVTyNFN4BulqjU2onpCy1BzZs Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 720fe6eaea524e23b60da4aa4a4973e3 Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:41:33.485194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:41:33.486535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_720fe6eaea524e23b60da4aa4a4973e3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:41:33.486535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:33.486535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 720fe6eaea524e23b60da4aa4a4973e3 Jun 24 08:41:33.486535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:33.486535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesNegativeTest-777821456-project Jun 24 08:41:33.486535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:41:33.486535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:41:33.486535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 18303519eb03426ba068c044a352775d Jun 24 08:41:33.486535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesNegativeTest-777821456-project Jun 24 08:41:33.486535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: Jun 24 08:41:33.486535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Volume a19a2ee9-6a94-46e4-84d5-4f23edbd3286 could not be found. Jun 24 08:41:33.486535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': 'a19a2ee9-6a94-46e4-84d5-4f23edbd3286'} Jun 24 08:41:33.486535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a19a2ee9-6a94-46e4-84d5-4f23edbd3286 could not be found. (HTTP 404) (Request-ID: req-0e49e80c-6fe8-4758-a5d7-2148c66f12b4) Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:33.487738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:41:33.489271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a19a2ee9-6a94-46e4-84d5-4f23edbd3286 could not be found. Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 08:41:33.491408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:41:33.492598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a19a2ee9-6a94-46e4-84d5-4f23edbd3286 could not be found. Jun 24 08:41:33.492598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.492598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:33.492598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.492598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:33.492598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:33.492598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:33.492598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:41:33.492598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:41:33.492598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a19a2ee9-6a94-46e4-84d5-4f23edbd3286 could not be found. Jun 24 08:41:33.492598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.492598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b0964a08-efa8-4c4f-9360-3c9a389dfa16 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Returning 404 to user: Volume a19a2ee9-6a94-46e4-84d5-4f23edbd3286 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:41:33.492598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b0964a08-efa8-4c4f-9360-3c9a389dfa16 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/a19a2ee9-6a94-46e4-84d5-4f23edbd3286" status: 404 len: 109 microversion: 2.1 time: 0.212321 Jun 24 08:41:33.492598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 7/7] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Jun 24 08:41:33 2022] DELETE /compute/v2.1/os-volumes/a19a2ee9-6a94-46e4-84d5-4f23edbd3286 => generated 109 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:41:33.505752 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e6d3475d-f636-4be4-85dc-4e266c432475 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Calling method '.version_select at 0x7fb75e73bee0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:33.635017 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-e6d3475d-f636-4be4-85dc-4e266c432475 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] HTTP exception thrown: Volume e1c19a64-1b1d-4fe4-93ac-12aa3080adc8 could not be found. Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e6d3475d-f636-4be4-85dc-4e266c432475 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Request method failure captured: Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/os-volumes/e1c19a64-1b1d-4fe4-93ac-12aa3080adc8 HTTP/1.1 Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXi5vL8_n5vRVRJ3wFMW2KuKxLb4GB33iOL8WbWIcqTQ4w1qfwu4AAjHqJGYFDeGOEXqeVzJyDVe2hXT3r9R2poUvbKJjFelb0auLHWF4TjPN9kagrxRSluajKS3MwPpK9uAuEhg28RkqJuTtPHoDByVTyNFN4BulqjU2onpCy1BzZs Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 720fe6eaea524e23b60da4aa4a4973e3 Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:41:33.636995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:41:33.638321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_720fe6eaea524e23b60da4aa4a4973e3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/720fe6eaea524e23b60da4aa4a4973e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:41:33.638321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:33.638321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 720fe6eaea524e23b60da4aa4a4973e3 Jun 24 08:41:33.638321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesNegativeTest-777821456 Jun 24 08:41:33.638321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesNegativeTest-777821456-project Jun 24 08:41:33.638321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:41:33.638321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:41:33.638321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 18303519eb03426ba068c044a352775d Jun 24 08:41:33.638321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesNegativeTest-777821456-project Jun 24 08:41:33.638321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: Jun 24 08:41:33.638321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Volume e1c19a64-1b1d-4fe4-93ac-12aa3080adc8 could not be found. Jun 24 08:41:33.638321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': 'e1c19a64-1b1d-4fe4-93ac-12aa3080adc8'} Jun 24 08:41:33.638321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e1c19a64-1b1d-4fe4-93ac-12aa3080adc8 could not be found. (HTTP 404) (Request-ID: req-fe3977d6-2939-4dc2-9cc1-806aa351d3d1) Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:33.639150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:41:33.640383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e1c19a64-1b1d-4fe4-93ac-12aa3080adc8 could not be found. Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 08:41:33.644759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:41:33.649179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e1c19a64-1b1d-4fe4-93ac-12aa3080adc8 could not be found. Jun 24 08:41:33.649179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.649179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:33.649179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.649179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:33.649179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:33.649179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:33.649179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:41:33.649179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:41:33.649179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e1c19a64-1b1d-4fe4-93ac-12aa3080adc8 could not be found. Jun 24 08:41:33.649179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:33.649179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e6d3475d-f636-4be4-85dc-4e266c432475 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] Returning 404 to user: Volume e1c19a64-1b1d-4fe4-93ac-12aa3080adc8 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:41:33.649179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e6d3475d-f636-4be4-85dc-4e266c432475 tempest-VolumesNegativeTest-777821456 tempest-VolumesNegativeTest-777821456-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/e1c19a64-1b1d-4fe4-93ac-12aa3080adc8" status: 404 len: 109 microversion: 2.1 time: 0.143541 Jun 24 08:41:33.649179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 8/8] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:41:33 2022] GET /compute/v2.1/os-volumes/e1c19a64-1b1d-4fe4-93ac-12aa3080adc8 => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:41:34.025892 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d3d40769-aca3-4307-9919-f4427686e47a tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.608730 Jun 24 08:41:34.026706 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 1/9] 10.222.0.43 () {60 vars in 1154 bytes} [Fri Jun 24 08:41:30 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3611 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 08:41:34.040378 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3c65b918-39f1-4b5e-b716-6677fb8efe3c tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e860d30>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:34.225696 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3c65b918-39f1-4b5e-b716-6677fb8efe3c tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2" status: 200 len: 345 microversion: 2.1 time: 0.191155 Jun 24 08:41:34.226991 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 9/10] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:41:34 2022] GET /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2 => generated 345 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:35.242939 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0cc09481-d481-4a0a-945c-e5220e7f6733 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e7a65e0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:35.362661 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0cc09481-d481-4a0a-945c-e5220e7f6733 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2" status: 200 len: 345 microversion: 2.1 time: 0.126586 Jun 24 08:41:35.365326 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 2/11] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:41:35 2022] GET /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2 => generated 345 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:36.382252 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cc1de0ef-3ef4-4cb5-999f-ea7756a99917 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e78a310>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:36.458110 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cc1de0ef-3ef4-4cb5-999f-ea7756a99917 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2" status: 200 len: 346 microversion: 2.1 time: 0.084198 Jun 24 08:41:36.464568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 10/12] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:41:36 2022] GET /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2 => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:36.469727 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d9836ba4-5e1e-4556-907f-189cb7cc73d1 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Action: 'create', calling method: .version_select at 0x7fb75e7a68b0>, body: {"snapshot": {"volume_id": "66951aa4-7229-435d-a385-ec30e8fa0ee2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-53843531"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:36.964895 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d9836ba4-5e1e-4556-907f-189cb7cc73d1 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.498554 Jun 24 08:41:36.967468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 3/13] 10.222.0.43 () {60 vars in 1161 bytes} [Fri Jun 24 08:41:36 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:36.977448 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-de0572c8-290a-4e44-af7b-3d16d152fa51 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e73b820>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:37.119253 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-de0572c8-290a-4e44-af7b-3d16d152fa51 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed" status: 200 len: 285 microversion: 2.1 time: 0.141784 Jun 24 08:41:37.119253 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 11/14] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Jun 24 08:41:36 2022] GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:37.126893 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2fff7cc4-312a-45d3-89e6-4a51f9713be7 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e73f1f0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:37.223324 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2fff7cc4-312a-45d3-89e6-4a51f9713be7 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.100246 Jun 24 08:41:37.224879 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 4/15] 10.222.0.43 () {58 vars in 1139 bytes} [Fri Jun 24 08:41:37 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:37.235600 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-55507b74-5e37-4500-8c65-1f665f222730 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e6c70d0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:37.319615 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-55507b74-5e37-4500-8c65-1f665f222730 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed" status: 200 len: 285 microversion: 2.1 time: 0.088078 Jun 24 08:41:37.320324 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 12/16] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Jun 24 08:41:37 2022] GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:38.331829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-17fbc12a-bd1a-4cc8-9dfa-6a7ae6f55bee tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e73fee0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:38.386277 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-17fbc12a-bd1a-4cc8-9dfa-6a7ae6f55bee tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed" status: 200 len: 285 microversion: 2.1 time: 0.058382 Jun 24 08:41:38.387065 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 5/17] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Jun 24 08:41:38 2022] GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed => generated 285 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:39.398951 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b249a1b9-c5c0-48df-a2af-3100ca2c8dbe tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e73faf0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:39.487135 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b249a1b9-c5c0-48df-a2af-3100ca2c8dbe tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed" status: 200 len: 285 microversion: 2.1 time: 0.093069 Jun 24 08:41:39.489101 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 6/18] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Jun 24 08:41:39 2022] GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:41:39.510724 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-400757423", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:39.727095 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] validate_networks() for [('d3ac0d05-2596-446f-acfb-1d270fd8725c', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:41:40.500962 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f83930e3-1341-4572-9d52-0cf5be027f81 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e73f550>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:40.596415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f83930e3-1341-4572-9d52-0cf5be027f81 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed" status: 200 len: 285 microversion: 2.1 time: 0.099492 Jun 24 08:41:40.597627 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 7/19] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Jun 24 08:41:40 2022] GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:41.608877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9634ea37-7b31-4cab-ad72-4464c27ced85 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e7a6ee0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:41.686066 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9634ea37-7b31-4cab-ad72-4464c27ced85 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed" status: 200 len: 285 microversion: 2.1 time: 0.082003 Jun 24 08:41:41.686685 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 8/20] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Jun 24 08:41:41 2022] GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed => generated 285 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:41:42.472038 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:41:42.472647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:41:42.472918 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:41:42.473331 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:41:42.474270 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:41:42.489705 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:42.490423 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:42.491407 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:42.492011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:42.535689 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Getting quotas for project edde4704253a4439bd7ca50b26e24e40. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:41:42.544137 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Getting quotas for user 9abdce8004e24e81bd88bee757d8ec93 and project edde4704253a4439bd7ca50b26e24e40. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:41:42.563881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:41:42.567083 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:41:42.676403 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9845b3a4-831a-4aa0-8655-23ab020e897c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.772010 Jun 24 08:41:42.688104 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bb14c178-58ed-4b2d-bbf4-e9c6289983d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:42.688970 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bb14c178-58ed-4b2d-bbf4-e9c6289983d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:42.693724 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 13/21] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:41:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 3790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:41:42.705450 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8ec9e949-6bfa-4a1e-9b92-db224994eb28 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e639d30>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:42.785008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8ec9e949-6bfa-4a1e-9b92-db224994eb28 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed" status: 200 len: 285 microversion: 2.1 time: 0.090315 Jun 24 08:41:42.785951 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 14/22] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Jun 24 08:41:42 2022] GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:42.933355 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bb14c178-58ed-4b2d-bbf4-e9c6289983d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:42.965368 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bb14c178-58ed-4b2d-bbf4-e9c6289983d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1221 microversion: 2.1 time: 0.281346 Jun 24 08:41:42.993323 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 9/23] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:42 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1221 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:43.342888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-64432181", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:43.454831 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] validate_networks() for [('d3ac0d05-2596-446f-acfb-1d270fd8725c', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:41:43.798366 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4633b86a-8c36-4396-b34d-16f72ad8e2d3 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e702e50>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:43.871852 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4633b86a-8c36-4396-b34d-16f72ad8e2d3 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed" status: 200 len: 286 microversion: 2.1 time: 0.078068 Jun 24 08:41:43.874060 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 10/24] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Jun 24 08:41:43 2022] GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:41:43.884985 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9e30e435-a102-420f-a950-b64095a3bcab tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e702700>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:44.330185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9e30e435-a102-420f-a950-b64095a3bcab tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed" status: 202 len: 0 microversion: 2.1 time: 0.450964 Jun 24 08:41:44.331267 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 11/25] 10.222.0.43 () {58 vars in 1253 bytes} [Fri Jun 24 08:41:43 2022] DELETE /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:41:44.341958 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-924ff406-ed27-485c-819e-2ad42892901a tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e70c280>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:44.405068 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-924ff406-ed27-485c-819e-2ad42892901a tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed" status: 200 len: 285 microversion: 2.1 time: 0.068819 Jun 24 08:41:44.406148 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 12/26] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Jun 24 08:41:44 2022] GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed => generated 285 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:41:44.481826 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:41:44.482664 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:41:44.482977 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:41:44.483504 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:41:44.484105 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:41:44.509577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:44.510058 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:44.510871 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:44.511345 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:44.575763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Getting quotas for project edde4704253a4439bd7ca50b26e24e40. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:41:44.595171 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Getting quotas for user 9abdce8004e24e81bd88bee757d8ec93 and project edde4704253a4439bd7ca50b26e24e40. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:41:44.640754 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:41:44.645809 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:41:44.784482 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c2b2ce88-3290-4347-b3dc-d382f44f320b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.452176 Jun 24 08:41:44.790133 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 15/27] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:41:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:41:44.810282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d3eb313e-6f1f-497a-9094-e145c144af6f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:44.812168 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d3eb313e-6f1f-497a-9094-e145c144af6f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:44.895457 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d3eb313e-6f1f-497a-9094-e145c144af6f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:44.911602 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d3eb313e-6f1f-497a-9094-e145c144af6f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1220 microversion: 2.1 time: 0.111869 Jun 24 08:41:44.912794 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 16/28] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:44 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1220 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:45.421374 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8026eb79-8330-462e-af72-07e89efa5bdf tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75ddf1c10>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:45.488209 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-8026eb79-8330-462e-af72-07e89efa5bdf tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] HTTP exception thrown: Snapshot 8c231035-3edc-4297-9fe3-d9a4914513ed could not be found. Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8026eb79-8330-462e-af72-07e89efa5bdf tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Request method failure captured: Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed HTTP/1.1 Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXi6tdEvfMCEsemnKV8VlFullwJAkMJACBb4bbdqgpQTOjJq-SW1EewAlesfBAHDmbqrws8rP2-KINsqcgQ6Ts0-v-DQAsCtSC5OCC8TihVbjyNkzQivNFEHUuio67iHtps-M1tgxc5_zI8kMyAwah1hUES3YLp0pkjiFHwDmo5qPEE Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 0586fe42a68745ec86eaca054e20ffea Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-927841216 Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:41:45.491622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:41:45.492821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0586fe42a68745ec86eaca054e20ffea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0586fe42a68745ec86eaca054e20ffea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0586fe42a68745ec86eaca054e20ffea", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0586fe42a68745ec86eaca054e20ffea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:41:45.492821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesSnapshotsTestJSON-927841216 Jun 24 08:41:45.492821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 0586fe42a68745ec86eaca054e20ffea Jun 24 08:41:45.492821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-927841216 Jun 24 08:41:45.492821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesSnapshotsTestJSON-927841216-project Jun 24 08:41:45.492821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:41:45.492821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:41:45.492821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 826d10a724bc4c34bb8807220898b175 Jun 24 08:41:45.492821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesSnapshotsTestJSON-927841216-project Jun 24 08:41:45.492821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: Jun 24 08:41:45.492821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Snapshot 8c231035-3edc-4297-9fe3-d9a4914513ed could not be found. Jun 24 08:41:45.492821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '8c231035-3edc-4297-9fe3-d9a4914513ed'} Jun 24 08:41:45.492821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8c231035-3edc-4297-9fe3-d9a4914513ed could not be found. (HTTP 404) (Request-ID: req-65c121cb-3238-472d-9a7f-1bf73ce110ab) Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:45.495256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:41:45.496389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8c231035-3edc-4297-9fe3-d9a4914513ed could not be found. Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 24 08:41:45.498480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:41:45.500629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8c231035-3edc-4297-9fe3-d9a4914513ed could not be found. Jun 24 08:41:45.500629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:45.500629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:45.500629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:45.500629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:45.500629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:45.500629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:45.500629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:41:45.500629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:41:45.500629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8c231035-3edc-4297-9fe3-d9a4914513ed could not be found. Jun 24 08:41:45.500629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:45.502626 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8026eb79-8330-462e-af72-07e89efa5bdf tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Returning 404 to user: Snapshot 8c231035-3edc-4297-9fe3-d9a4914513ed could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:41:45.502626 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8026eb79-8330-462e-af72-07e89efa5bdf tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed" status: 404 len: 111 microversion: 2.1 time: 0.087740 Jun 24 08:41:45.503778 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 17/29] 10.222.0.43 () {58 vars in 1250 bytes} [Fri Jun 24 08:41:45 2022] GET /compute/v2.1/os-snapshots/8c231035-3edc-4297-9fe3-d9a4914513ed => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:41:45.514942 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cad0d4c1-a0f6-4ca8-9b2d-d53711d139d5 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75d57e8b0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:45.548952 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f98db083-084f-417f-98d4-ff1b53e3399b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Action: 'create', calling method: .version_select at 0x7fb75e70c670>, body: {"keypair": {"name": "tempest-keypair-1692042545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKR6mVihPoRGkSdQNt+rNm6zC2wdeF0D7qoHTRqH/Mlq76z/SWAQnRm9PYrUqHAOHG2aDpvbyCT3cRQmvxeUK2S8Tb9yz+x357diyiGCiGRD3SswQx4Aa3bJ9yvHpLBpg=="}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:45.756749 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-f98db083-084f-417f-98d4-ff1b53e3399b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Getting quotas for project 150883a8e55c459a9f41fc48f8f81b0c. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:41:45.796843 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cad0d4c1-a0f6-4ca8-9b2d-d53711d139d5 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2" status: 202 len: 0 microversion: 2.1 time: 0.286863 Jun 24 08:41:45.798010 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 18/30] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Jun 24 08:41:45 2022] DELETE /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:41:45.807140 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-612361e2-1e2e-4b94-b531-2d7b0eddbca9 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75d593040>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:45.815536 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-f98db083-084f-417f-98d4-ff1b53e3399b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Getting quotas for user 12f0ce0a293f4114a90098985e5f21ee and project 150883a8e55c459a9f41fc48f8f81b0c. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:41:45.951284 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-612361e2-1e2e-4b94-b531-2d7b0eddbca9 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2" status: 200 len: 345 microversion: 2.1 time: 0.149063 Jun 24 08:41:45.951855 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 19/31] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:41:45 2022] GET /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2 => generated 345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:41:45.956684 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e3da50a6-b6af-45fc-a4dc-489055f5789b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:45.957487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e3da50a6-b6af-45fc-a4dc-489055f5789b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:46.045462 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f98db083-084f-417f-98d4-ff1b53e3399b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.637822 Jun 24 08:41:46.058931 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 13/32] 10.222.0.43 () {62 vars in 1199 bytes} [Fri Jun 24 08:41:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1652 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 08:41:46.239347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e3da50a6-b6af-45fc-a4dc-489055f5789b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:46.255666 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e3da50a6-b6af-45fc-a4dc-489055f5789b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1220 microversion: 2.1 time: 0.301989 Jun 24 08:41:46.262513 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 20/33] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:45 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1220 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:46.964395 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0f913822-e57d-45cd-bc17-7cd7efe65469 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75ddf14c0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:47.041663 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2095578310", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "networks": [{"uuid": "0520e9a8-c0f3-4bf7-9ab5-d4b872487727"}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:47.196795 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] validate_networks() for [('0520e9a8-c0f3-4bf7-9ab5-d4b872487727', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:41:47.201325 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-0f913822-e57d-45cd-bc17-7cd7efe65469 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] HTTP exception thrown: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0f913822-e57d-45cd-bc17-7cd7efe65469 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Request method failure captured: Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2 HTTP/1.1 Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXi6tdEvfMCEsemnKV8VlFullwJAkMJACBb4bbdqgpQTOjJq-SW1EewAlesfBAHDmbqrws8rP2-KINsqcgQ6Ts0-v-DQAsCtSC5OCC8TihVbjyNkzQivNFEHUuio67iHtps-M1tgxc5_zI8kMyAwah1hUES3YLp0pkjiFHwDmo5qPEE Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 0586fe42a68745ec86eaca054e20ffea Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-927841216 Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:41:47.203571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:41:47.204881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0586fe42a68745ec86eaca054e20ffea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0586fe42a68745ec86eaca054e20ffea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0586fe42a68745ec86eaca054e20ffea", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0586fe42a68745ec86eaca054e20ffea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:41:47.204881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesSnapshotsTestJSON-927841216 Jun 24 08:41:47.204881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 0586fe42a68745ec86eaca054e20ffea Jun 24 08:41:47.204881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-927841216 Jun 24 08:41:47.204881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesSnapshotsTestJSON-927841216-project Jun 24 08:41:47.204881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:41:47.204881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:41:47.204881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 826d10a724bc4c34bb8807220898b175 Jun 24 08:41:47.204881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesSnapshotsTestJSON-927841216-project Jun 24 08:41:47.204881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: Jun 24 08:41:47.204881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:47.204881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '66951aa4-7229-435d-a385-ec30e8fa0ee2'} Jun 24 08:41:47.204881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. (HTTP 404) (Request-ID: req-bf9f48ee-7660-4f40-a1a9-e5d4e2ca049d) Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:47.205641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:41:47.206621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 08:41:47.207774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:41:47.208938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:47.208938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:47.208938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:47.208938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:47.208938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:47.208938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:47.208938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:47.208938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:41:47.208938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:41:47.208938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:47.208938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:47.208938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0f913822-e57d-45cd-bc17-7cd7efe65469 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Returning 404 to user: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:41:47.208938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0f913822-e57d-45cd-bc17-7cd7efe65469 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2" status: 404 len: 109 microversion: 2.1 time: 0.244761 Jun 24 08:41:47.208938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 21/34] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:41:46 2022] GET /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2 => generated 109 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:41:47.224528 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-54eb868d-72cb-462e-8dee-1b6c890591ff tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75e860ca0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:47.364857 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-54eb868d-72cb-462e-8dee-1b6c890591ff tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] HTTP exception thrown: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-54eb868d-72cb-462e-8dee-1b6c890591ff tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Request method failure captured: Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2 HTTP/1.1 Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXi6tdEvfMCEsemnKV8VlFullwJAkMJACBb4bbdqgpQTOjJq-SW1EewAlesfBAHDmbqrws8rP2-KINsqcgQ6Ts0-v-DQAsCtSC5OCC8TihVbjyNkzQivNFEHUuio67iHtps-M1tgxc5_zI8kMyAwah1hUES3YLp0pkjiFHwDmo5qPEE Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 0586fe42a68745ec86eaca054e20ffea Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-927841216 Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:41:47.368613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:41:47.369844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0586fe42a68745ec86eaca054e20ffea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0586fe42a68745ec86eaca054e20ffea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0586fe42a68745ec86eaca054e20ffea", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0586fe42a68745ec86eaca054e20ffea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:41:47.369844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesSnapshotsTestJSON-927841216 Jun 24 08:41:47.369844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 0586fe42a68745ec86eaca054e20ffea Jun 24 08:41:47.369844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-927841216 Jun 24 08:41:47.369844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesSnapshotsTestJSON-927841216-project Jun 24 08:41:47.369844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:41:47.369844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:41:47.369844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 826d10a724bc4c34bb8807220898b175 Jun 24 08:41:47.369844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesSnapshotsTestJSON-927841216-project Jun 24 08:41:47.369844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: Jun 24 08:41:47.369844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:47.369844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '66951aa4-7229-435d-a385-ec30e8fa0ee2'} Jun 24 08:41:47.369844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. (HTTP 404) (Request-ID: req-99c70926-9c14-4f72-9617-0c14b55bce67) Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:47.370526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:41:47.371606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 08:41:47.372534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:41:47.374406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:47.374406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:47.374406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:47.374406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:47.374406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:47.374406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:47.374406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:47.374406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:41:47.374406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:41:47.374406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:47.374406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:47.377231 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-54eb868d-72cb-462e-8dee-1b6c890591ff tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Returning 404 to user: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:41:47.380918 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-54eb868d-72cb-462e-8dee-1b6c890591ff tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2" status: 404 len: 109 microversion: 2.1 time: 0.158852 Jun 24 08:41:47.381752 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 22/35] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Jun 24 08:41:47 2022] DELETE /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2 => generated 109 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:41:47.388763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-52c1c350-b36e-4544-b5f3-8dc7582b81eb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:47.396643 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-52c1c350-b36e-4544-b5f3-8dc7582b81eb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:47.430590 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52c1c350-b36e-4544-b5f3-8dc7582b81eb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:47.431080 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52c1c350-b36e-4544-b5f3-8dc7582b81eb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:47.431938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52c1c350-b36e-4544-b5f3-8dc7582b81eb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:47.432390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52c1c350-b36e-4544-b5f3-8dc7582b81eb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:47.889348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-52c1c350-b36e-4544-b5f3-8dc7582b81eb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:47.914708 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-52c1c350-b36e-4544-b5f3-8dc7582b81eb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1224 microversion: 2.1 time: 0.531652 Jun 24 08:41:47.962312 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 23/36] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:47 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1224 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:47.986600 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-342bfc31-7f5a-482e-88c3-fdc211d36204 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Calling method '.version_select at 0x7fb75d5930d0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:48.300584 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-342bfc31-7f5a-482e-88c3-fdc211d36204 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] HTTP exception thrown: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-342bfc31-7f5a-482e-88c3-fdc211d36204 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Request method failure captured: Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2 HTTP/1.1 Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXi6tdEvfMCEsemnKV8VlFullwJAkMJACBb4bbdqgpQTOjJq-SW1EewAlesfBAHDmbqrws8rP2-KINsqcgQ6Ts0-v-DQAsCtSC5OCC8TihVbjyNkzQivNFEHUuio67iHtps-M1tgxc5_zI8kMyAwah1hUES3YLp0pkjiFHwDmo5qPEE Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 0586fe42a68745ec86eaca054e20ffea Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-927841216 Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:41:48.303823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:41:48.305229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0586fe42a68745ec86eaca054e20ffea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0586fe42a68745ec86eaca054e20ffea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0586fe42a68745ec86eaca054e20ffea", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0586fe42a68745ec86eaca054e20ffea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:41:48.305229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesSnapshotsTestJSON-927841216 Jun 24 08:41:48.305229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 0586fe42a68745ec86eaca054e20ffea Jun 24 08:41:48.305229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-927841216 Jun 24 08:41:48.305229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesSnapshotsTestJSON-927841216-project Jun 24 08:41:48.305229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:41:48.305229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:41:48.305229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 826d10a724bc4c34bb8807220898b175 Jun 24 08:41:48.305229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesSnapshotsTestJSON-927841216-project Jun 24 08:41:48.305229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: Jun 24 08:41:48.305229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:48.305229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '66951aa4-7229-435d-a385-ec30e8fa0ee2'} Jun 24 08:41:48.305229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. (HTTP 404) (Request-ID: req-d9a9b046-b04d-4c8b-9b5e-d04c3cf193ff) Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:48.306093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:41:48.307301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 08:41:48.308368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:41:48.309502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:48.309502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:48.309502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:41:48.309502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:48.309502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:41:48.309502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:41:48.309502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:41:48.309502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:41:48.309502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:41:48.309502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. Jun 24 08:41:48.309502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:41:48.309502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-342bfc31-7f5a-482e-88c3-fdc211d36204 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] Returning 404 to user: Volume 66951aa4-7229-435d-a385-ec30e8fa0ee2 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:41:48.309502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-342bfc31-7f5a-482e-88c3-fdc211d36204 tempest-VolumesSnapshotsTestJSON-927841216 tempest-VolumesSnapshotsTestJSON-927841216-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2" status: 404 len: 109 microversion: 2.1 time: 0.343742 Jun 24 08:41:48.309502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 24/37] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:41:47 2022] GET /compute/v2.1/os-volumes/66951aa4-7229-435d-a385-ec30e8fa0ee2 => generated 109 bytes in 348 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:41:48.802813 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:41:48.803778 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:41:48.804274 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:41:48.804841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:41:48.805403 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:41:48.829235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:48.832443 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:48.833387 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:48.837783 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:48.927449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Getting quotas for project 6b1d15dc76094127a7f84c79dbb3053c. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:41:48.933380 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Getting quotas for user f83e72cd0d7e47b6bbfc4ffe64b71922 and project 6b1d15dc76094127a7f84c79dbb3053c. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:41:48.969335 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1fe37c8c-8b88-4fa9-a9d7-05ec40e9fed3 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:48.974282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1fe37c8c-8b88-4fa9-a9d7-05ec40e9fed3 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:48.987031 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:41:48.990493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1fe37c8c-8b88-4fa9-a9d7-05ec40e9fed3 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:48.992131 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1fe37c8c-8b88-4fa9-a9d7-05ec40e9fed3 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:48.993103 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1fe37c8c-8b88-4fa9-a9d7-05ec40e9fed3 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:48.993686 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1fe37c8c-8b88-4fa9-a9d7-05ec40e9fed3 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:48.994203 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:41:49.249832 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3ab5be25-4ac8-41cc-8b02-6dc9fceda8f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.433743 Jun 24 08:41:49.256214 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 14/38] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:41:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:41:49.271540 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-578b5560-e2cb-43f8-8e6d-2e39f3ed4a56 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:49.273442 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-578b5560-e2cb-43f8-8e6d-2e39f3ed4a56 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:49.421019 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1fe37c8c-8b88-4fa9-a9d7-05ec40e9fed3 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:49.433320 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1fe37c8c-8b88-4fa9-a9d7-05ec40e9fed3 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1290 microversion: 2.1 time: 0.481836 Jun 24 08:41:49.447324 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 25/39] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:48 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1290 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:50.225565 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-578b5560-e2cb-43f8-8e6d-2e39f3ed4a56 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:50.242488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-578b5560-e2cb-43f8-8e6d-2e39f3ed4a56 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1215 microversion: 2.1 time: 0.984604 Jun 24 08:41:50.246046 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 15/40] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:49 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1215 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:50.452391 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b1ca04b4-6db0-4536-a892-a4e2e89cb187 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:50.453837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b1ca04b4-6db0-4536-a892-a4e2e89cb187 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:50.466416 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b1ca04b4-6db0-4536-a892-a4e2e89cb187 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:50.468310 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b1ca04b4-6db0-4536-a892-a4e2e89cb187 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:50.471028 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b1ca04b4-6db0-4536-a892-a4e2e89cb187 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:50.472663 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b1ca04b4-6db0-4536-a892-a4e2e89cb187 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:51.261937 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-aa374ab2-b213-4ee2-9ac5-11f7fcc699d6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:51.268105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-aa374ab2-b213-4ee2-9ac5-11f7fcc699d6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:51.282079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa374ab2-b213-4ee2-9ac5-11f7fcc699d6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:51.296683 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa374ab2-b213-4ee2-9ac5-11f7fcc699d6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:51.298268 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa374ab2-b213-4ee2-9ac5-11f7fcc699d6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:51.298852 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa374ab2-b213-4ee2-9ac5-11f7fcc699d6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:51.349388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b1ca04b4-6db0-4536-a892-a4e2e89cb187 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:51.387763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b1ca04b4-6db0-4536-a892-a4e2e89cb187 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1278 microversion: 2.1 time: 0.935886 Jun 24 08:41:51.400983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 26/41] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:50 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1278 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:52.030096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-aa374ab2-b213-4ee2-9ac5-11f7fcc699d6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:52.078673 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-aa374ab2-b213-4ee2-9ac5-11f7fcc699d6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1267 microversion: 2.1 time: 0.812899 Jun 24 08:41:52.079911 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 16/42] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:51 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1267 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:52.409598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b9dc838f-e8b3-4ffc-b4ff-f79e04cfc89e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:52.412013 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b9dc838f-e8b3-4ffc-b4ff-f79e04cfc89e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:52.437113 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b9dc838f-e8b3-4ffc-b4ff-f79e04cfc89e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:52.442364 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b9dc838f-e8b3-4ffc-b4ff-f79e04cfc89e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:52.444288 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b9dc838f-e8b3-4ffc-b4ff-f79e04cfc89e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:52.448806 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b9dc838f-e8b3-4ffc-b4ff-f79e04cfc89e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:52.682014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b9dc838f-e8b3-4ffc-b4ff-f79e04cfc89e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:52.696370 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b9dc838f-e8b3-4ffc-b4ff-f79e04cfc89e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1278 microversion: 2.1 time: 0.291446 Jun 24 08:41:52.698050 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 27/43] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:52 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1278 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:53.096946 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e8619644-8665-4c83-99a8-50045dde1a83 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:53.098228 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e8619644-8665-4c83-99a8-50045dde1a83 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:53.113425 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8619644-8665-4c83-99a8-50045dde1a83 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:53.115817 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8619644-8665-4c83-99a8-50045dde1a83 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:53.117096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8619644-8665-4c83-99a8-50045dde1a83 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:53.118874 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e8619644-8665-4c83-99a8-50045dde1a83 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:53.445631 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e8619644-8665-4c83-99a8-50045dde1a83 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:53.456120 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e8619644-8665-4c83-99a8-50045dde1a83 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1275 microversion: 2.1 time: 0.363974 Jun 24 08:41:53.460715 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 17/44] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:53 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1275 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:53.577607 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-524107951", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "679fe362-1384-4e2b-bdfd-6758eea022f3"}], "security_groups": [{"name": "tempest-securitygroup--359850961"}], "key_name": "tempest-keypair-1692042545", "user_data": "}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:41:53.714373 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-57bc8731-b52f-412a-997e-85bd1b544bdf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:53.715242 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-57bc8731-b52f-412a-997e-85bd1b544bdf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:53.722152 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-57bc8731-b52f-412a-997e-85bd1b544bdf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:53.722981 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-57bc8731-b52f-412a-997e-85bd1b544bdf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:53.724695 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-57bc8731-b52f-412a-997e-85bd1b544bdf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:53.725359 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-57bc8731-b52f-412a-997e-85bd1b544bdf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:53.929757 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] validate_networks() for [('679fe362-1384-4e2b-bdfd-6758eea022f3', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:41:54.521455 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:54.952037 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-57bc8731-b52f-412a-997e-85bd1b544bdf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:54.964228 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-57bc8731-b52f-412a-997e-85bd1b544bdf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 1.254187 Jun 24 08:41:54.964975 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 18/45] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:53 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:54.969998 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-06d46a07-2050-4d39-9b26-bf7288022ff6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:54.970614 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-06d46a07-2050-4d39-9b26-bf7288022ff6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:55.000969 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06d46a07-2050-4d39-9b26-bf7288022ff6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:55.001434 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06d46a07-2050-4d39-9b26-bf7288022ff6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:55.002837 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06d46a07-2050-4d39-9b26-bf7288022ff6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:55.005461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06d46a07-2050-4d39-9b26-bf7288022ff6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:55.123563 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-06d46a07-2050-4d39-9b26-bf7288022ff6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:55.131712 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-06d46a07-2050-4d39-9b26-bf7288022ff6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1275 microversion: 2.1 time: 0.165447 Jun 24 08:41:55.137644 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 19/46] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:54 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:55.542503 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:41:55.543020 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:41:55.543447 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:41:55.543836 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:41:55.544892 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:41:55.557369 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:55.557833 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:55.563754 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:55.567110 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:55.597835 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Getting quotas for project 150883a8e55c459a9f41fc48f8f81b0c. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:41:55.603703 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Getting quotas for user 12f0ce0a293f4114a90098985e5f21ee and project 150883a8e55c459a9f41fc48f8f81b0c. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:41:55.631377 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:41:55.641065 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:41:55.792415 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a590a55b-ddfd-4e16-b7db-25c7a96ed034 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.219811 Jun 24 08:41:55.793565 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 28/47] 10.222.0.43 () {62 vars in 1187 bytes} [Fri Jun 24 08:41:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 2222 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 08:41:55.804829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f93dea25-5b1b-4b9c-ae29-97511a5514c7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:55.805873 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f93dea25-5b1b-4b9c-ae29-97511a5514c7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:55.940780 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f93dea25-5b1b-4b9c-ae29-97511a5514c7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:55.954724 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f93dea25-5b1b-4b9c-ae29-97511a5514c7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:55.960965 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f93dea25-5b1b-4b9c-ae29-97511a5514c7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:55.962120 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f93dea25-5b1b-4b9c-ae29-97511a5514c7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1281 microversion: 2.20 time: 0.162341 Jun 24 08:41:55.966429 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 20/48] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:55 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1281 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:55.984496 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b27c76b8-5651-4b63-8758-88b6a1dcc783 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:55.985304 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b27c76b8-5651-4b63-8758-88b6a1dcc783 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:55.997182 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b27c76b8-5651-4b63-8758-88b6a1dcc783 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:55.997754 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b27c76b8-5651-4b63-8758-88b6a1dcc783 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:55.999899 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b27c76b8-5651-4b63-8758-88b6a1dcc783 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:56.001576 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b27c76b8-5651-4b63-8758-88b6a1dcc783 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:56.149395 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fddf8303-daa0-4be6-a3ec-cb647d72c3e6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:56.150011 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fddf8303-daa0-4be6-a3ec-cb647d72c3e6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:56.173860 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fddf8303-daa0-4be6-a3ec-cb647d72c3e6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:56.174225 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fddf8303-daa0-4be6-a3ec-cb647d72c3e6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:56.182429 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fddf8303-daa0-4be6-a3ec-cb647d72c3e6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:56.184013 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fddf8303-daa0-4be6-a3ec-cb647d72c3e6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:56.448131 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fddf8303-daa0-4be6-a3ec-cb647d72c3e6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:56.461237 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fddf8303-daa0-4be6-a3ec-cb647d72c3e6 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1285 microversion: 2.1 time: 0.313263 Jun 24 08:41:56.474184 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 21/49] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:56 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1285 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:41:56.570716 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b27c76b8-5651-4b63-8758-88b6a1dcc783 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:56.579589 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b27c76b8-5651-4b63-8758-88b6a1dcc783 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.599505 Jun 24 08:41:56.587159 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 29/50] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:55 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:56.987258 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-92acb3b4-f7ae-46aa-8022-eb67864a5534 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:56.987991 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-92acb3b4-f7ae-46aa-8022-eb67864a5534 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:56.993995 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92acb3b4-f7ae-46aa-8022-eb67864a5534 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:56.994448 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92acb3b4-f7ae-46aa-8022-eb67864a5534 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:56.995243 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92acb3b4-f7ae-46aa-8022-eb67864a5534 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:56.995669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92acb3b4-f7ae-46aa-8022-eb67864a5534 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:57.078556 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-92acb3b4-f7ae-46aa-8022-eb67864a5534 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:57.087719 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-92acb3b4-f7ae-46aa-8022-eb67864a5534 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:57.089730 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-92acb3b4-f7ae-46aa-8022-eb67864a5534 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:57.091038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-92acb3b4-f7ae-46aa-8022-eb67864a5534 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1285 microversion: 2.20 time: 0.108545 Jun 24 08:41:57.091975 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 22/51] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:56 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:57.482916 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-01a7561e-f65c-4822-9b5a-7d8f546dd8be tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:57.483025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-01a7561e-f65c-4822-9b5a-7d8f546dd8be tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:57.489894 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-01a7561e-f65c-4822-9b5a-7d8f546dd8be tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:57.490453 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-01a7561e-f65c-4822-9b5a-7d8f546dd8be tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:57.491130 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-01a7561e-f65c-4822-9b5a-7d8f546dd8be tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:57.491796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-01a7561e-f65c-4822-9b5a-7d8f546dd8be tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:57.570386 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-01a7561e-f65c-4822-9b5a-7d8f546dd8be tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:57.590011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-01a7561e-f65c-4822-9b5a-7d8f546dd8be tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1273 microversion: 2.1 time: 0.112881 Jun 24 08:41:57.592131 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 30/52] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:57 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:57.601604 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dd298891-6051-4be1-a6e7-ffc0c61a143f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:57.602215 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dd298891-6051-4be1-a6e7-ffc0c61a143f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:57.608293 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd298891-6051-4be1-a6e7-ffc0c61a143f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:57.608743 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd298891-6051-4be1-a6e7-ffc0c61a143f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:57.609774 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd298891-6051-4be1-a6e7-ffc0c61a143f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:57.610373 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd298891-6051-4be1-a6e7-ffc0c61a143f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:57.771561 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dd298891-6051-4be1-a6e7-ffc0c61a143f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:57.782010 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dd298891-6051-4be1-a6e7-ffc0c61a143f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.184072 Jun 24 08:41:57.782610 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 23/53] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:57 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:58.113940 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-68dd6149-c366-49b1-bca5-0c146cec96b9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:58.114701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-68dd6149-c366-49b1-bca5-0c146cec96b9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:58.121104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68dd6149-c366-49b1-bca5-0c146cec96b9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:58.121497 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68dd6149-c366-49b1-bca5-0c146cec96b9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:58.122262 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68dd6149-c366-49b1-bca5-0c146cec96b9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:58.122693 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68dd6149-c366-49b1-bca5-0c146cec96b9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:58.194339 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-68dd6149-c366-49b1-bca5-0c146cec96b9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:58.203060 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-68dd6149-c366-49b1-bca5-0c146cec96b9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:58.204629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-68dd6149-c366-49b1-bca5-0c146cec96b9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:58.205742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-68dd6149-c366-49b1-bca5-0c146cec96b9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1285 microversion: 2.20 time: 0.097169 Jun 24 08:41:58.207640 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 31/54] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:58 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:58.608326 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fd65f059-e114-4d9a-8a53-981d0eed1da7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:58.609527 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fd65f059-e114-4d9a-8a53-981d0eed1da7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:58.616221 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd65f059-e114-4d9a-8a53-981d0eed1da7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:58.616842 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd65f059-e114-4d9a-8a53-981d0eed1da7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:58.617615 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd65f059-e114-4d9a-8a53-981d0eed1da7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:58.618084 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fd65f059-e114-4d9a-8a53-981d0eed1da7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:58.697047 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fd65f059-e114-4d9a-8a53-981d0eed1da7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:58.705671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fd65f059-e114-4d9a-8a53-981d0eed1da7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1273 microversion: 2.1 time: 0.101131 Jun 24 08:41:58.706914 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 24/55] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:58 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:58.806151 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b791bd05-8e55-488f-b24c-aa49a85f7223 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:58.806783 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b791bd05-8e55-488f-b24c-aa49a85f7223 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:58.818149 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b791bd05-8e55-488f-b24c-aa49a85f7223 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:58.818505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b791bd05-8e55-488f-b24c-aa49a85f7223 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:58.820316 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b791bd05-8e55-488f-b24c-aa49a85f7223 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:58.823552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b791bd05-8e55-488f-b24c-aa49a85f7223 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:59.074691 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b791bd05-8e55-488f-b24c-aa49a85f7223 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:59.083310 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b791bd05-8e55-488f-b24c-aa49a85f7223 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.282437 Jun 24 08:41:59.085618 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 32/56] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:58 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:59.225902 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-97b7aeb1-5502-41c3-85c7-bf7f01c213fd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:59.226575 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-97b7aeb1-5502-41c3-85c7-bf7f01c213fd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:59.228584 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:59.235796 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97b7aeb1-5502-41c3-85c7-bf7f01c213fd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:59.236490 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97b7aeb1-5502-41c3-85c7-bf7f01c213fd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:59.237279 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97b7aeb1-5502-41c3-85c7-bf7f01c213fd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:59.237722 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97b7aeb1-5502-41c3-85c7-bf7f01c213fd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:59.342239 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-97b7aeb1-5502-41c3-85c7-bf7f01c213fd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:59.355557 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-97b7aeb1-5502-41c3-85c7-bf7f01c213fd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:59.357667 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-97b7aeb1-5502-41c3-85c7-bf7f01c213fd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:59.359393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-97b7aeb1-5502-41c3-85c7-bf7f01c213fd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1285 microversion: 2.20 time: 0.138015 Jun 24 08:41:59.360573 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 25/57] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:41:59 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:59.722777 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c85625d6-f508-4c5d-ab8e-961c8651f8a5 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:59.723697 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c85625d6-f508-4c5d-ab8e-961c8651f8a5 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:41:59.729646 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c85625d6-f508-4c5d-ab8e-961c8651f8a5 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:59.730091 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c85625d6-f508-4c5d-ab8e-961c8651f8a5 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:59.730846 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c85625d6-f508-4c5d-ab8e-961c8651f8a5 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:59.731360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c85625d6-f508-4c5d-ab8e-961c8651f8a5 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:59.804524 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c85625d6-f508-4c5d-ab8e-961c8651f8a5 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:41:59.820181 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c85625d6-f508-4c5d-ab8e-961c8651f8a5 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1273 microversion: 2.1 time: 0.101079 Jun 24 08:41:59.821400 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 33/58] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:41:59 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:00.101646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2c9ba84f-8c72-48a9-84dc-84bb5c7da1c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:00.102359 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2c9ba84f-8c72-48a9-84dc-84bb5c7da1c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:00.108382 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c9ba84f-8c72-48a9-84dc-84bb5c7da1c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:00.108913 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c9ba84f-8c72-48a9-84dc-84bb5c7da1c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:00.109750 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c9ba84f-8c72-48a9-84dc-84bb5c7da1c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:00.110283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c9ba84f-8c72-48a9-84dc-84bb5c7da1c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:00.245225 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2c9ba84f-8c72-48a9-84dc-84bb5c7da1c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:00.252459 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2c9ba84f-8c72-48a9-84dc-84bb5c7da1c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.154619 Jun 24 08:42:00.252977 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 26/59] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:00 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:00.377763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bcf9a244-e527-4c8c-b5bb-4e7b38b8327a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:00.378377 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bcf9a244-e527-4c8c-b5bb-4e7b38b8327a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:00.380343 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=9 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:00.386041 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bcf9a244-e527-4c8c-b5bb-4e7b38b8327a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:00.386492 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bcf9a244-e527-4c8c-b5bb-4e7b38b8327a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:00.387287 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bcf9a244-e527-4c8c-b5bb-4e7b38b8327a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:00.387726 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bcf9a244-e527-4c8c-b5bb-4e7b38b8327a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:00.451632 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bcf9a244-e527-4c8c-b5bb-4e7b38b8327a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:00.463978 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bcf9a244-e527-4c8c-b5bb-4e7b38b8327a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:00.465491 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bcf9a244-e527-4c8c-b5bb-4e7b38b8327a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:00.466970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bcf9a244-e527-4c8c-b5bb-4e7b38b8327a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1285 microversion: 2.20 time: 0.092958 Jun 24 08:42:00.467669 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 34/60] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:00 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:00.841883 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ed4bb4e6-4e0f-4395-bf17-7cb0abb94d24 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:00.843664 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ed4bb4e6-4e0f-4395-bf17-7cb0abb94d24 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:00.852019 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed4bb4e6-4e0f-4395-bf17-7cb0abb94d24 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:00.853224 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed4bb4e6-4e0f-4395-bf17-7cb0abb94d24 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:00.854284 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed4bb4e6-4e0f-4395-bf17-7cb0abb94d24 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:00.854931 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ed4bb4e6-4e0f-4395-bf17-7cb0abb94d24 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:00.945696 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ed4bb4e6-4e0f-4395-bf17-7cb0abb94d24 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:00.953516 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ed4bb4e6-4e0f-4395-bf17-7cb0abb94d24 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1273 microversion: 2.1 time: 0.117003 Jun 24 08:42:00.954862 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 27/61] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:00 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:01.277672 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7e11b19b-d53d-4202-9c2c-886739effb82 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:01.278093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7e11b19b-d53d-4202-9c2c-886739effb82 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:01.291517 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7e11b19b-d53d-4202-9c2c-886739effb82 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:01.292097 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7e11b19b-d53d-4202-9c2c-886739effb82 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:01.293436 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7e11b19b-d53d-4202-9c2c-886739effb82 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:01.297178 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7e11b19b-d53d-4202-9c2c-886739effb82 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:01.475716 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7e11b19b-d53d-4202-9c2c-886739effb82 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:01.485165 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7e11b19b-d53d-4202-9c2c-886739effb82 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.219005 Jun 24 08:42:01.486206 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 35/62] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:01 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:01.499960 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-06c31d6c-eb87-4ea1-bb71-c3ca795d2380 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:01.499960 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-06c31d6c-eb87-4ea1-bb71-c3ca795d2380 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:01.499960 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06c31d6c-eb87-4ea1-bb71-c3ca795d2380 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:01.499960 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06c31d6c-eb87-4ea1-bb71-c3ca795d2380 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:01.500742 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06c31d6c-eb87-4ea1-bb71-c3ca795d2380 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:01.500742 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-06c31d6c-eb87-4ea1-bb71-c3ca795d2380 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:01.585270 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-06c31d6c-eb87-4ea1-bb71-c3ca795d2380 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:01.594266 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-06c31d6c-eb87-4ea1-bb71-c3ca795d2380 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:01.596319 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-06c31d6c-eb87-4ea1-bb71-c3ca795d2380 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:01.597788 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-06c31d6c-eb87-4ea1-bb71-c3ca795d2380 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1285 microversion: 2.20 time: 0.115776 Jun 24 08:42:01.598555 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 28/63] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:01 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:01.972716 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ecb08099-e549-45f9-b2fc-2d946e514c87 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:01.973332 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ecb08099-e549-45f9-b2fc-2d946e514c87 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:01.984328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ecb08099-e549-45f9-b2fc-2d946e514c87 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:01.984833 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ecb08099-e549-45f9-b2fc-2d946e514c87 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:01.985541 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ecb08099-e549-45f9-b2fc-2d946e514c87 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:01.986727 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ecb08099-e549-45f9-b2fc-2d946e514c87 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:02.069758 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ecb08099-e549-45f9-b2fc-2d946e514c87 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:02.088166 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ecb08099-e549-45f9-b2fc-2d946e514c87 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1273 microversion: 2.1 time: 0.119681 Jun 24 08:42:02.088990 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 36/64] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:01 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:02.510860 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f70a8ff2-2c6b-4bbe-a090-543b328fbc05 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:02.512415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f70a8ff2-2c6b-4bbe-a090-543b328fbc05 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:02.518938 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f70a8ff2-2c6b-4bbe-a090-543b328fbc05 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:02.519961 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f70a8ff2-2c6b-4bbe-a090-543b328fbc05 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:02.521022 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f70a8ff2-2c6b-4bbe-a090-543b328fbc05 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:02.521665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f70a8ff2-2c6b-4bbe-a090-543b328fbc05 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:02.617978 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-71c468f0-4225-47ee-9899-909f4923cb72 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:02.618742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-71c468f0-4225-47ee-9899-909f4923cb72 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:02.626830 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-71c468f0-4225-47ee-9899-909f4923cb72 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:02.627813 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-71c468f0-4225-47ee-9899-909f4923cb72 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:02.628876 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-71c468f0-4225-47ee-9899-909f4923cb72 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:02.630374 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-71c468f0-4225-47ee-9899-909f4923cb72 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:02.722420 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-71c468f0-4225-47ee-9899-909f4923cb72 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:02.732616 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-71c468f0-4225-47ee-9899-909f4923cb72 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:02.734791 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-71c468f0-4225-47ee-9899-909f4923cb72 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:02.736644 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-71c468f0-4225-47ee-9899-909f4923cb72 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1285 microversion: 2.20 time: 0.122867 Jun 24 08:42:02.737710 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 37/65] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:02 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:02.812718 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f70a8ff2-2c6b-4bbe-a090-543b328fbc05 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:02.820523 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f70a8ff2-2c6b-4bbe-a090-543b328fbc05 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.313764 Jun 24 08:42:02.831095 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 29/66] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:02 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:03.106004 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-df27a559-ffa8-4fca-ae8b-c5148ef5f846 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:03.107136 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-df27a559-ffa8-4fca-ae8b-c5148ef5f846 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:03.115468 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-df27a559-ffa8-4fca-ae8b-c5148ef5f846 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:03.116252 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-df27a559-ffa8-4fca-ae8b-c5148ef5f846 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:03.117264 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-df27a559-ffa8-4fca-ae8b-c5148ef5f846 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:03.117927 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-df27a559-ffa8-4fca-ae8b-c5148ef5f846 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:03.199571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-df27a559-ffa8-4fca-ae8b-c5148ef5f846 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:03.211609 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-df27a559-ffa8-4fca-ae8b-c5148ef5f846 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1273 microversion: 2.1 time: 0.109589 Jun 24 08:42:03.221575 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 38/67] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:03 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:03.255227 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c7403e9b-2162-4bee-8b05-66060a1b7264 tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] Calling method '.version_select at 0x7fb75cdbba60>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:03.353218 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c7403e9b-2162-4bee-8b05-66060a1b7264 tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/3bec6e8e-504f-4511-9b25-8c68ecd8d877" status: 200 len: 351 microversion: 2.1 time: 0.103665 Jun 24 08:42:03.354042 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 30/68] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:42:03 2022] GET /compute/v2.1/os-volumes/3bec6e8e-504f-4511-9b25-8c68ecd8d877 => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:03.755983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a4060a66-4c5b-436c-a70a-ee885c1875d1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:03.757475 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a4060a66-4c5b-436c-a70a-ee885c1875d1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:03.766038 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a4060a66-4c5b-436c-a70a-ee885c1875d1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:03.773986 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a4060a66-4c5b-436c-a70a-ee885c1875d1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:03.774983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a4060a66-4c5b-436c-a70a-ee885c1875d1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:03.775600 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a4060a66-4c5b-436c-a70a-ee885c1875d1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:03.843755 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-21d2266b-8105-4cf6-bd06-998bddf7e5df tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:03.845595 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-21d2266b-8105-4cf6-bd06-998bddf7e5df tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:03.855716 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21d2266b-8105-4cf6-bd06-998bddf7e5df tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:03.862620 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21d2266b-8105-4cf6-bd06-998bddf7e5df tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:03.867494 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21d2266b-8105-4cf6-bd06-998bddf7e5df tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:03.870663 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21d2266b-8105-4cf6-bd06-998bddf7e5df tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:03.948509 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a4060a66-4c5b-436c-a70a-ee885c1875d1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:03.967606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a4060a66-4c5b-436c-a70a-ee885c1875d1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:03.969928 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a4060a66-4c5b-436c-a70a-ee885c1875d1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:03.972073 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a4060a66-4c5b-436c-a70a-ee885c1875d1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1285 microversion: 2.20 time: 0.220486 Jun 24 08:42:03.986379 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 39/69] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:03 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1285 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:04.178138 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-21d2266b-8105-4cf6-bd06-998bddf7e5df tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:04.195580 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-21d2266b-8105-4cf6-bd06-998bddf7e5df tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.359534 Jun 24 08:42:04.199886 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 31/70] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:03 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:04.233059 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d24501d3-18bc-4197-8977-9d5511cbc684 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:04.237543 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d24501d3-18bc-4197-8977-9d5511cbc684 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:04.250398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d24501d3-18bc-4197-8977-9d5511cbc684 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:04.255405 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d24501d3-18bc-4197-8977-9d5511cbc684 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:04.256839 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d24501d3-18bc-4197-8977-9d5511cbc684 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:04.257761 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d24501d3-18bc-4197-8977-9d5511cbc684 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:04.337265 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:04.440804 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d24501d3-18bc-4197-8977-9d5511cbc684 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:04.449622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d24501d3-18bc-4197-8977-9d5511cbc684 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1273 microversion: 2.1 time: 0.224510 Jun 24 08:42:04.450501 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 40/71] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:04 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:04.994784 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c59b344d-a14f-42a1-aae2-4ffbeb10963e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:04.995445 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c59b344d-a14f-42a1-aae2-4ffbeb10963e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:05.002024 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c59b344d-a14f-42a1-aae2-4ffbeb10963e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.002788 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c59b344d-a14f-42a1-aae2-4ffbeb10963e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:05.004086 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c59b344d-a14f-42a1-aae2-4ffbeb10963e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.005600 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c59b344d-a14f-42a1-aae2-4ffbeb10963e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:05.070875 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c59b344d-a14f-42a1-aae2-4ffbeb10963e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:05.080255 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c59b344d-a14f-42a1-aae2-4ffbeb10963e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:05.081788 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c59b344d-a14f-42a1-aae2-4ffbeb10963e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:05.083017 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c59b344d-a14f-42a1-aae2-4ffbeb10963e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1285 microversion: 2.20 time: 0.093372 Jun 24 08:42:05.084369 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 32/72] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:04 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:05.218483 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d3c42b02-adaf-4191-aeb6-eb1897a4018b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:05.219770 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d3c42b02-adaf-4191-aeb6-eb1897a4018b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:05.225312 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3c42b02-adaf-4191-aeb6-eb1897a4018b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.225760 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3c42b02-adaf-4191-aeb6-eb1897a4018b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:05.226722 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3c42b02-adaf-4191-aeb6-eb1897a4018b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.227358 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3c42b02-adaf-4191-aeb6-eb1897a4018b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:05.409970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d3c42b02-adaf-4191-aeb6-eb1897a4018b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:05.420748 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d3c42b02-adaf-4191-aeb6-eb1897a4018b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.207104 Jun 24 08:42:05.421477 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 41/73] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:05 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:05.467147 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-91a61082-1a61-4d4b-b9cf-d81e6a281681 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:05.468157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-91a61082-1a61-4d4b-b9cf-d81e6a281681 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:05.475237 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91a61082-1a61-4d4b-b9cf-d81e6a281681 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.476027 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91a61082-1a61-4d4b-b9cf-d81e6a281681 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:05.477142 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91a61082-1a61-4d4b-b9cf-d81e6a281681 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:05.477858 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91a61082-1a61-4d4b-b9cf-d81e6a281681 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:05.548256 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-91a61082-1a61-4d4b-b9cf-d81e6a281681 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:05.556207 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-91a61082-1a61-4d4b-b9cf-d81e6a281681 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1273 microversion: 2.1 time: 0.093051 Jun 24 08:42:05.556906 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 33/74] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:05 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:05.969454 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-222ac269-8535-4efe-8921-85c42ddb12b3 tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] Calling method '.version_select at 0x7fb75d50a940>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:05.976388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:05.977204 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=22 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:06.031837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-222ac269-8535-4efe-8921-85c42ddb12b3 tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/cb93f3aa-2b93-4476-8fd7-a00b7ef0a2e3" status: 200 len: 351 microversion: 2.1 time: 0.066226 Jun 24 08:42:06.033339 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 42/75] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:42:05 2022] GET /compute/v2.1/os-volumes/cb93f3aa-2b93-4476-8fd7-a00b7ef0a2e3 => generated 351 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:06.104121 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7bd3db35-150b-4b27-800a-170283ef5d80 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:06.106422 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7bd3db35-150b-4b27-800a-170283ef5d80 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:06.108505 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=16 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:06.116675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7bd3db35-150b-4b27-800a-170283ef5d80 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:06.118242 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7bd3db35-150b-4b27-800a-170283ef5d80 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:06.119125 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7bd3db35-150b-4b27-800a-170283ef5d80 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:06.119609 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7bd3db35-150b-4b27-800a-170283ef5d80 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:06.124764 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:06.194749 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7bd3db35-150b-4b27-800a-170283ef5d80 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:06.203303 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7bd3db35-150b-4b27-800a-170283ef5d80 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:06.204817 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7bd3db35-150b-4b27-800a-170283ef5d80 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:06.206159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7bd3db35-150b-4b27-800a-170283ef5d80 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1285 microversion: 2.20 time: 0.108297 Jun 24 08:42:06.206715 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 34/76] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:06 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:06.437930 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-fe72f74e-a200-4627-8e69-7c991e555789 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:06.439233 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-fe72f74e-a200-4627-8e69-7c991e555789 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:06.449940 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fe72f74e-a200-4627-8e69-7c991e555789 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:06.450634 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fe72f74e-a200-4627-8e69-7c991e555789 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:06.451720 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fe72f74e-a200-4627-8e69-7c991e555789 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:06.452135 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fe72f74e-a200-4627-8e69-7c991e555789 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:06.574601 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e638073c-b22f-4767-9134-54e993eb6a07 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:06.576022 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e638073c-b22f-4767-9134-54e993eb6a07 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:06.584903 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e638073c-b22f-4767-9134-54e993eb6a07 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:06.585474 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e638073c-b22f-4767-9134-54e993eb6a07 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:06.586344 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e638073c-b22f-4767-9134-54e993eb6a07 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:06.587418 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e638073c-b22f-4767-9134-54e993eb6a07 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:06.613329 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-fe72f74e-a200-4627-8e69-7c991e555789 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:06.623760 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-fe72f74e-a200-4627-8e69-7c991e555789 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.189594 Jun 24 08:42:06.624364 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 43/77] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:06 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:06.681175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e638073c-b22f-4767-9134-54e993eb6a07 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:06.689627 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e638073c-b22f-4767-9134-54e993eb6a07 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1273 microversion: 2.1 time: 0.119610 Jun 24 08:42:06.690182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 35/78] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:06 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:07.226559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a6ee39ea-088b-4911-ac8f-2686383358d3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:07.227164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a6ee39ea-088b-4911-ac8f-2686383358d3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:07.233262 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a6ee39ea-088b-4911-ac8f-2686383358d3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:07.233708 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a6ee39ea-088b-4911-ac8f-2686383358d3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:07.234474 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a6ee39ea-088b-4911-ac8f-2686383358d3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:07.234903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a6ee39ea-088b-4911-ac8f-2686383358d3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:07.313609 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a6ee39ea-088b-4911-ac8f-2686383358d3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:07.322533 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a6ee39ea-088b-4911-ac8f-2686383358d3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:07.324389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a6ee39ea-088b-4911-ac8f-2686383358d3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:07.325731 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a6ee39ea-088b-4911-ac8f-2686383358d3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1285 microversion: 2.20 time: 0.103683 Jun 24 08:42:07.326699 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 44/79] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:07 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:07.640550 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-01e23a31-3da8-4712-8d13-b38053d4cfbd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:07.641156 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-01e23a31-3da8-4712-8d13-b38053d4cfbd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:07.647522 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01e23a31-3da8-4712-8d13-b38053d4cfbd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:07.647967 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01e23a31-3da8-4712-8d13-b38053d4cfbd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:07.648727 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01e23a31-3da8-4712-8d13-b38053d4cfbd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:07.649155 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01e23a31-3da8-4712-8d13-b38053d4cfbd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:07.707264 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-955ed365-9eb7-4202-9796-23d3887eaeb0 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:07.708280 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-955ed365-9eb7-4202-9796-23d3887eaeb0 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:07.714892 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-955ed365-9eb7-4202-9796-23d3887eaeb0 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:07.715556 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-955ed365-9eb7-4202-9796-23d3887eaeb0 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:07.716163 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-955ed365-9eb7-4202-9796-23d3887eaeb0 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:07.716660 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-955ed365-9eb7-4202-9796-23d3887eaeb0 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:07.791496 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-955ed365-9eb7-4202-9796-23d3887eaeb0 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:07.799198 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-955ed365-9eb7-4202-9796-23d3887eaeb0 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1273 microversion: 2.1 time: 0.095945 Jun 24 08:42:07.809346 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 45/80] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:07 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:07.837458 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-01e23a31-3da8-4712-8d13-b38053d4cfbd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:07.853421 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-01e23a31-3da8-4712-8d13-b38053d4cfbd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.216669 Jun 24 08:42:07.855000 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 36/81] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:07 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:08.350945 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b2fa187b-c3e2-497a-9c19-0afffbeecf87 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:08.352091 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b2fa187b-c3e2-497a-9c19-0afffbeecf87 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:08.370460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2fa187b-c3e2-497a-9c19-0afffbeecf87 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:08.371126 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2fa187b-c3e2-497a-9c19-0afffbeecf87 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:08.378237 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2fa187b-c3e2-497a-9c19-0afffbeecf87 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:08.378815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2fa187b-c3e2-497a-9c19-0afffbeecf87 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:08.483026 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b2fa187b-c3e2-497a-9c19-0afffbeecf87 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:08.505871 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b2fa187b-c3e2-497a-9c19-0afffbeecf87 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:08.507670 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b2fa187b-c3e2-497a-9c19-0afffbeecf87 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:08.508825 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b2fa187b-c3e2-497a-9c19-0afffbeecf87 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1285 microversion: 2.20 time: 0.168561 Jun 24 08:42:08.509786 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 46/82] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:08 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:08.510499 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c1f5744a-7af8-4689-9e6a-adef668ba05e tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] Calling method '.version_select at 0x7fb75cdbb0d0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:08.578576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c1f5744a-7af8-4689-9e6a-adef668ba05e tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/df3f7446-3136-456f-9298-ef6c6ed623da" status: 200 len: 350 microversion: 2.1 time: 0.073662 Jun 24 08:42:08.579274 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 37/83] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:42:08 2022] GET /compute/v2.1/os-volumes/df3f7446-3136-456f-9298-ef6c6ed623da => generated 350 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:42:08.591018 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2352f972-5061-499b-83f5-f30415382099 tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] Calling method '.version_select at 0x7fb75d4fcca0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:08.697145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2352f972-5061-499b-83f5-f30415382099 tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.110294 Jun 24 08:42:08.697713 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 47/84] 10.222.0.43 () {58 vars in 1133 bytes} [Fri Jun 24 08:42:08 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:08.713242 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-47e1226a-3296-462a-ab91-3957064b7791 tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] Calling method '.version_select at 0x7fb75ccfe0d0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:08.816794 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-718eea85-3329-4c15-8b8d-78f7ee2dbf48 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:08.819602 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-718eea85-3329-4c15-8b8d-78f7ee2dbf48 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:08.826997 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-718eea85-3329-4c15-8b8d-78f7ee2dbf48 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:08.831742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-718eea85-3329-4c15-8b8d-78f7ee2dbf48 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:08.836179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-718eea85-3329-4c15-8b8d-78f7ee2dbf48 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:08.836817 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-718eea85-3329-4c15-8b8d-78f7ee2dbf48 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:08.880924 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-47e1226a-3296-462a-ab91-3957064b7791 tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.172491 Jun 24 08:42:08.889428 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 38/85] 10.222.0.43 () {58 vars in 1148 bytes} [Fri Jun 24 08:42:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:08.894815 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8dec96b9-4365-4e5b-9d8f-46ad9e497054 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:08.895992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8dec96b9-4365-4e5b-9d8f-46ad9e497054 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:08.927701 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8dec96b9-4365-4e5b-9d8f-46ad9e497054 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:08.928411 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8dec96b9-4365-4e5b-9d8f-46ad9e497054 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:08.929345 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8dec96b9-4365-4e5b-9d8f-46ad9e497054 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:08.929941 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8dec96b9-4365-4e5b-9d8f-46ad9e497054 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:09.216024 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-718eea85-3329-4c15-8b8d-78f7ee2dbf48 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:09.230117 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-718eea85-3329-4c15-8b8d-78f7ee2dbf48 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1273 microversion: 2.1 time: 0.416713 Jun 24 08:42:09.231876 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 48/86] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:08 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1273 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:09.238529 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a5e7bdc8-1630-45b5-a49c-795be4a1d62f tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] Calling method '.version_select at 0x7fb75d4ca940>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:09.418423 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a5e7bdc8-1630-45b5-a49c-795be4a1d62f tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.184978 Jun 24 08:42:09.419439 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 49/87] 10.222.0.43 () {58 vars in 1133 bytes} [Fri Jun 24 08:42:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:09.430719 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-85082026-e9b1-43e5-8bff-79ba10dd12fb tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] Calling method '.version_select at 0x7fb75d4fc9d0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:09.534416 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-85082026-e9b1-43e5-8bff-79ba10dd12fb tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.107579 Jun 24 08:42:09.541899 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 50/88] 10.222.0.43 () {58 vars in 1166 bytes} [Fri Jun 24 08:42:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:09.541899 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-082f74b4-300b-49c1-9604-fe0f115e3455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:09.541899 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-082f74b4-300b-49c1-9604-fe0f115e3455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:09.552766 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-082f74b4-300b-49c1-9604-fe0f115e3455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:09.553215 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-082f74b4-300b-49c1-9604-fe0f115e3455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:09.553986 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-082f74b4-300b-49c1-9604-fe0f115e3455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:09.554406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-082f74b4-300b-49c1-9604-fe0f115e3455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:09.814576 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-082f74b4-300b-49c1-9604-fe0f115e3455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:09.828367 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-082f74b4-300b-49c1-9604-fe0f115e3455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:09.835791 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8dec96b9-4365-4e5b-9d8f-46ad9e497054 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:09.836289 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-082f74b4-300b-49c1-9604-fe0f115e3455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:09.839437 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-082f74b4-300b-49c1-9604-fe0f115e3455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1339 microversion: 2.20 time: 0.300739 Jun 24 08:42:09.840062 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 51/89] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:09 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1339 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:09.850742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f11273cf-3b55-4b06-865c-4e69032f7fb8 tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] Calling method '.version_select at 0x7fb75d4fc8b0>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:09.862792 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8dec96b9-4365-4e5b-9d8f-46ad9e497054 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.971823 Jun 24 08:42:09.863962 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 39/90] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:08 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:10.000147 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f11273cf-3b55-4b06-865c-4e69032f7fb8 tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.158941 Jun 24 08:42:10.000714 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 52/91] 10.222.0.43 () {58 vars in 1169 bytes} [Fri Jun 24 08:42:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:10.012911 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3e6c2638-fb54-4cea-bf29-7c215b8053a1 tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] Calling method '.version_select at 0x7fb75cd06310>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:10.124273 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3e6c2638-fb54-4cea-bf29-7c215b8053a1 tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.114943 Jun 24 08:42:10.141741 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-99f1a93b-83b1-42b9-ab83-ba9f70baf03d tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] Calling method '.version_select at 0x7fb75d4caf70>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:10.147195 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 40/92] 10.222.0.43 () {58 vars in 1154 bytes} [Fri Jun 24 08:42:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:10.228438 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-99f1a93b-83b1-42b9-ab83-ba9f70baf03d tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090641 Jun 24 08:42:10.229282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 53/93] 10.222.0.43 () {58 vars in 1187 bytes} [Fri Jun 24 08:42:10 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:10.241083 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a68e98ca-218a-41d4-9098-e53fbf6a2d2c tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] Calling method '.version_select at 0x7fb75cd4f1f0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:10.253508 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e78ff4c4-043f-4a44-b77a-579472b1e9fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:10.255517 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e78ff4c4-043f-4a44-b77a-579472b1e9fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:10.262640 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e78ff4c4-043f-4a44-b77a-579472b1e9fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:10.263440 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e78ff4c4-043f-4a44-b77a-579472b1e9fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:10.264402 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e78ff4c4-043f-4a44-b77a-579472b1e9fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:10.265023 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e78ff4c4-043f-4a44-b77a-579472b1e9fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:10.401896 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a68e98ca-218a-41d4-9098-e53fbf6a2d2c tempest-VolumesTestJSON-564820828 tempest-VolumesTestJSON-564820828-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.164580 Jun 24 08:42:10.418382 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 41/94] 10.222.0.43 () {58 vars in 1154 bytes} [Fri Jun 24 08:42:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:10.858889 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-19957e45-187c-423a-b96b-efc025659546 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:10.859608 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-19957e45-187c-423a-b96b-efc025659546 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:10.862331 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:10.876145 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19957e45-187c-423a-b96b-efc025659546 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:10.876902 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19957e45-187c-423a-b96b-efc025659546 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:10.877979 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19957e45-187c-423a-b96b-efc025659546 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:10.878596 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19957e45-187c-423a-b96b-efc025659546 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:10.934843 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e78ff4c4-043f-4a44-b77a-579472b1e9fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:10.952822 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e78ff4c4-043f-4a44-b77a-579472b1e9fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.709820 Jun 24 08:42:10.964336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 54/95] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:10 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:11.052778 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-bd86abee-9af2-42cd-a518-e19614fc6668 req-4fde5d98-5ee7-4536-920a-252a7b655535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b5105a-20c5-4e33-b0d8-74b5033b5c38", "tag": "0c02d8f2-b51b-4f5e-a580-5a4e41ddb70b"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:11.066921 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-bd86abee-9af2-42cd-a518-e19614fc6668 req-4fde5d98-5ee7-4536-920a-252a7b655535 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:11.075812 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-bd86abee-9af2-42cd-a518-e19614fc6668 req-4fde5d98-5ee7-4536-920a-252a7b655535 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:11.117073 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-bd86abee-9af2-42cd-a518-e19614fc6668 req-4fde5d98-5ee7-4536-920a-252a7b655535 service nova] Creating event network-changed:0c02d8f2-b51b-4f5e-a580-5a4e41ddb70b for instance b1b5105a-20c5-4e33-b0d8-74b5033b5c38 on hv-cinder-84517 Jun 24 08:42:11.118388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-bd86abee-9af2-42cd-a518-e19614fc6668 req-4fde5d98-5ee7-4536-920a-252a7b655535 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124379) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 08:42:11.119778 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c327f412-17b1-4b1a-8bc6-f641b5987768 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:11.120404 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c327f412-17b1-4b1a-8bc6-f641b5987768 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:11.121163 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c327f412-17b1-4b1a-8bc6-f641b5987768 None None] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:11.121883 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c327f412-17b1-4b1a-8bc6-f641b5987768 None None] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:11.132397 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.compute.rpcapi [None req-c327f412-17b1-4b1a-8bc6-f641b5987768 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 08:42:11.133625 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c327f412-17b1-4b1a-8bc6-f641b5987768 None None] Releasing lock "compute-rpcapi-router" {{(pid=124379) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 08:42:11.158156 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c327f412-17b1-4b1a-8bc6-f641b5987768 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187397 Jun 24 08:42:11.158775 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 55/96] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:11.162275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-19957e45-187c-423a-b96b-efc025659546 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:11.164770 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6851f4f9-af49-492e-837e-7514d793d2cd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:11.165728 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6851f4f9-af49-492e-837e-7514d793d2cd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:11.177464 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-19957e45-187c-423a-b96b-efc025659546 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:11.180396 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-19957e45-187c-423a-b96b-efc025659546 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:11.180928 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6851f4f9-af49-492e-837e-7514d793d2cd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:11.182797 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-19957e45-187c-423a-b96b-efc025659546 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1339 microversion: 2.20 time: 0.328694 Jun 24 08:42:11.183492 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6851f4f9-af49-492e-837e-7514d793d2cd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:11.185153 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 42/97] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:10 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1339 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:11.190248 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6851f4f9-af49-492e-837e-7514d793d2cd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:11.190916 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6851f4f9-af49-492e-837e-7514d793d2cd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:11.536548 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6851f4f9-af49-492e-837e-7514d793d2cd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:11.552262 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6851f4f9-af49-492e-837e-7514d793d2cd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.391894 Jun 24 08:42:11.554080 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 56/98] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:11 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:11.957750 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-e0f619c5-4a85-40eb-951e-993ab70c8f9a req-a8f8348c-841c-4924-9af8-582440ba7fcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9", "tag": "b4f1fb4a-3774-4faf-a4f3-7df9149cb8e7"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:11.986078 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-65a9317e-0ce7-4519-b06f-7c136a4b0a1a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:11.987417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-65a9317e-0ce7-4519-b06f-7c136a4b0a1a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:12.010099 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-65a9317e-0ce7-4519-b06f-7c136a4b0a1a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:12.012347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-65a9317e-0ce7-4519-b06f-7c136a4b0a1a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:12.015318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-65a9317e-0ce7-4519-b06f-7c136a4b0a1a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:12.015440 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-e0f619c5-4a85-40eb-951e-993ab70c8f9a req-a8f8348c-841c-4924-9af8-582440ba7fcd service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:12.015863 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-e0f619c5-4a85-40eb-951e-993ab70c8f9a req-a8f8348c-841c-4924-9af8-582440ba7fcd service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:12.018081 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-65a9317e-0ce7-4519-b06f-7c136a4b0a1a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:12.041915 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-e0f619c5-4a85-40eb-951e-993ab70c8f9a req-a8f8348c-841c-4924-9af8-582440ba7fcd service nova] Creating event network-changed:b4f1fb4a-3774-4faf-a4f3-7df9149cb8e7 for instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 on hv-cinder-84517 Jun 24 08:42:12.042457 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-e0f619c5-4a85-40eb-951e-993ab70c8f9a req-a8f8348c-841c-4924-9af8-582440ba7fcd service nova] Acquired lock "compute-rpcapi-router" {{(pid=124380) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 08:42:12.046977 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cfb7fcb7-eb4e-47e4-abf5-384b7f03c95d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:12.047585 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cfb7fcb7-eb4e-47e4-abf5-384b7f03c95d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:12.048399 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cfb7fcb7-eb4e-47e4-abf5-384b7f03c95d None None] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:12.048833 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cfb7fcb7-eb4e-47e4-abf5-384b7f03c95d None None] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:12.071242 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.compute.rpcapi [None req-cfb7fcb7-eb4e-47e4-abf5-384b7f03c95d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 08:42:12.072361 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cfb7fcb7-eb4e-47e4-abf5-384b7f03c95d None None] Releasing lock "compute-rpcapi-router" {{(pid=124380) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 08:42:12.108532 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cfb7fcb7-eb4e-47e4-abf5-384b7f03c95d None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238092 Jun 24 08:42:12.110054 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 43/99] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:12.204815 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-acc66aca-46f1-4f8e-89eb-84d7d2c2f8f7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:12.205678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-acc66aca-46f1-4f8e-89eb-84d7d2c2f8f7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:12.216018 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-acc66aca-46f1-4f8e-89eb-84d7d2c2f8f7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:12.216659 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-acc66aca-46f1-4f8e-89eb-84d7d2c2f8f7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:12.217591 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-acc66aca-46f1-4f8e-89eb-84d7d2c2f8f7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:12.218173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-acc66aca-46f1-4f8e-89eb-84d7d2c2f8f7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:12.404874 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-65a9317e-0ce7-4519-b06f-7c136a4b0a1a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:12.413103 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-65a9317e-0ce7-4519-b06f-7c136a4b0a1a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.436586 Jun 24 08:42:12.423505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 57/100] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:11 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:12.486092 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-acc66aca-46f1-4f8e-89eb-84d7d2c2f8f7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:12.495077 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-acc66aca-46f1-4f8e-89eb-84d7d2c2f8f7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:12.496788 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-acc66aca-46f1-4f8e-89eb-84d7d2c2f8f7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:12.498007 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-acc66aca-46f1-4f8e-89eb-84d7d2c2f8f7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.299794 Jun 24 08:42:12.498553 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 44/101] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:12 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:12.570278 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5a0654c1-98bb-44de-9656-ca93921b7a59 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:12.570988 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5a0654c1-98bb-44de-9656-ca93921b7a59 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:12.580714 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5a0654c1-98bb-44de-9656-ca93921b7a59 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:12.581366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5a0654c1-98bb-44de-9656-ca93921b7a59 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:12.582422 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5a0654c1-98bb-44de-9656-ca93921b7a59 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:12.583862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5a0654c1-98bb-44de-9656-ca93921b7a59 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:12.772641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5a0654c1-98bb-44de-9656-ca93921b7a59 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:12.780168 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5a0654c1-98bb-44de-9656-ca93921b7a59 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.214237 Jun 24 08:42:12.780734 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 58/102] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:12 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:13.430219 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cb50ba7a-f0eb-4dba-a34d-28355f2872eb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:13.430754 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cb50ba7a-f0eb-4dba-a34d-28355f2872eb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:13.436656 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb50ba7a-f0eb-4dba-a34d-28355f2872eb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:13.437100 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb50ba7a-f0eb-4dba-a34d-28355f2872eb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:13.437854 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb50ba7a-f0eb-4dba-a34d-28355f2872eb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:13.438282 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb50ba7a-f0eb-4dba-a34d-28355f2872eb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:13.516471 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1b011f23-d86b-4e58-8031-9e7e58e1103d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:13.517077 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1b011f23-d86b-4e58-8031-9e7e58e1103d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:13.525708 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b011f23-d86b-4e58-8031-9e7e58e1103d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:13.526142 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b011f23-d86b-4e58-8031-9e7e58e1103d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:13.531613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b011f23-d86b-4e58-8031-9e7e58e1103d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:13.532054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b011f23-d86b-4e58-8031-9e7e58e1103d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:13.591412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cb50ba7a-f0eb-4dba-a34d-28355f2872eb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:13.599997 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cb50ba7a-f0eb-4dba-a34d-28355f2872eb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.174103 Jun 24 08:42:13.601526 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 45/103] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:13 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:13.683983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1b011f23-d86b-4e58-8031-9e7e58e1103d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:13.692001 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1b011f23-d86b-4e58-8031-9e7e58e1103d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:13.693770 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1b011f23-d86b-4e58-8031-9e7e58e1103d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:13.694830 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1b011f23-d86b-4e58-8031-9e7e58e1103d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.182284 Jun 24 08:42:13.695419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 59/104] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:13 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:13.797186 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-04a4ea13-4948-40f0-a0f5-32def8d469c9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:13.798004 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-04a4ea13-4948-40f0-a0f5-32def8d469c9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:13.806066 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04a4ea13-4948-40f0-a0f5-32def8d469c9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:13.806600 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04a4ea13-4948-40f0-a0f5-32def8d469c9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:13.807532 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04a4ea13-4948-40f0-a0f5-32def8d469c9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:13.808161 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04a4ea13-4948-40f0-a0f5-32def8d469c9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:14.122573 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-04a4ea13-4948-40f0-a0f5-32def8d469c9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:14.135470 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-04a4ea13-4948-40f0-a0f5-32def8d469c9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.341735 Jun 24 08:42:14.136837 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 46/105] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:13 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:14.168529 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-ba27580f-57ce-4c52-9afa-5ce93388bf8f req-f9cacab5-a5e7-4b7e-8ec3-7dcbcf9132f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47cbea2-c37b-437e-9f72-539dd1b59f53", "tag": "78906aae-6d64-4560-9fa5-15138c397c8f"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:14.188841 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-ba27580f-57ce-4c52-9afa-5ce93388bf8f req-f9cacab5-a5e7-4b7e-8ec3-7dcbcf9132f6 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:14.191118 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-ba27580f-57ce-4c52-9afa-5ce93388bf8f req-f9cacab5-a5e7-4b7e-8ec3-7dcbcf9132f6 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:14.208490 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-ba27580f-57ce-4c52-9afa-5ce93388bf8f req-f9cacab5-a5e7-4b7e-8ec3-7dcbcf9132f6 service nova] Creating event network-changed:78906aae-6d64-4560-9fa5-15138c397c8f for instance f47cbea2-c37b-437e-9f72-539dd1b59f53 on hv-cinder-84517 Jun 24 08:42:14.217508 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-ba27580f-57ce-4c52-9afa-5ce93388bf8f req-f9cacab5-a5e7-4b7e-8ec3-7dcbcf9132f6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052921 Jun 24 08:42:14.218263 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 60/106] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:14.617956 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-74710a5b-5938-4eb9-9bad-41f298af8006 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:14.619504 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-74710a5b-5938-4eb9-9bad-41f298af8006 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:14.628685 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-74710a5b-5938-4eb9-9bad-41f298af8006 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:14.630774 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-74710a5b-5938-4eb9-9bad-41f298af8006 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:14.634415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-74710a5b-5938-4eb9-9bad-41f298af8006 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:14.635122 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-74710a5b-5938-4eb9-9bad-41f298af8006 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:14.713906 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2d1ca768-d476-475d-866a-7c63dd2b86df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:14.715685 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2d1ca768-d476-475d-866a-7c63dd2b86df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:14.728908 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d1ca768-d476-475d-866a-7c63dd2b86df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:14.729363 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d1ca768-d476-475d-866a-7c63dd2b86df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:14.730140 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d1ca768-d476-475d-866a-7c63dd2b86df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:14.730582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d1ca768-d476-475d-866a-7c63dd2b86df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:15.063819 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-74710a5b-5938-4eb9-9bad-41f298af8006 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:15.078377 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-74710a5b-5938-4eb9-9bad-41f298af8006 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.461786 Jun 24 08:42:15.093012 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 47/107] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:14 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:15.104304 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-e3398fd5-7e3d-4316-85a8-d4a3ccd00fc5 req-387e3c90-bd80-47c4-8691-a233c334a27e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f6b0e38-4e81-4595-9acd-ec8335bb5db5", "tag": "6c3b5569-2019-4bad-bd54-dc7ff5e8c6b1"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:15.126200 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-e3398fd5-7e3d-4316-85a8-d4a3ccd00fc5 req-387e3c90-bd80-47c4-8691-a233c334a27e service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:15.128607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-e3398fd5-7e3d-4316-85a8-d4a3ccd00fc5 req-387e3c90-bd80-47c4-8691-a233c334a27e service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:15.164776 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-e3398fd5-7e3d-4316-85a8-d4a3ccd00fc5 req-387e3c90-bd80-47c4-8691-a233c334a27e service nova] Creating event network-changed:6c3b5569-2019-4bad-bd54-dc7ff5e8c6b1 for instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 on hv-cinder-84517 Jun 24 08:42:15.175695 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-e3398fd5-7e3d-4316-85a8-d4a3ccd00fc5 req-387e3c90-bd80-47c4-8691-a233c334a27e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080876 Jun 24 08:42:15.177754 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2d1ca768-d476-475d-866a-7c63dd2b86df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:15.180438 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 48/108] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:15.204157 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2d1ca768-d476-475d-866a-7c63dd2b86df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:15.210306 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fef0c105-06a0-44e7-91ac-37eda4e66c9a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:15.214142 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2d1ca768-d476-475d-866a-7c63dd2b86df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:15.214570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fef0c105-06a0-44e7-91ac-37eda4e66c9a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:15.218202 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2d1ca768-d476-475d-866a-7c63dd2b86df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.509040 Jun 24 08:42:15.218762 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 61/109] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:14 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:15.236043 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fef0c105-06a0-44e7-91ac-37eda4e66c9a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:15.237013 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fef0c105-06a0-44e7-91ac-37eda4e66c9a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:15.238104 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fef0c105-06a0-44e7-91ac-37eda4e66c9a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:15.239903 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fef0c105-06a0-44e7-91ac-37eda4e66c9a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:15.707381 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fef0c105-06a0-44e7-91ac-37eda4e66c9a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:15.716147 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fef0c105-06a0-44e7-91ac-37eda4e66c9a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.530218 Jun 24 08:42:15.717172 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 49/110] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:15 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:16.105087 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ea17e280-cb8e-4177-8ffd-bd4e5ce2a0f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:16.105698 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ea17e280-cb8e-4177-8ffd-bd4e5ce2a0f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:16.111870 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea17e280-cb8e-4177-8ffd-bd4e5ce2a0f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:16.112315 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea17e280-cb8e-4177-8ffd-bd4e5ce2a0f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:16.113073 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea17e280-cb8e-4177-8ffd-bd4e5ce2a0f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:16.113620 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ea17e280-cb8e-4177-8ffd-bd4e5ce2a0f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:16.244084 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c16f4898-bc7d-4047-ac09-4a911382bc01 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:16.244696 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c16f4898-bc7d-4047-ac09-4a911382bc01 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:16.250376 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ea17e280-cb8e-4177-8ffd-bd4e5ce2a0f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:16.250558 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c16f4898-bc7d-4047-ac09-4a911382bc01 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:16.250981 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c16f4898-bc7d-4047-ac09-4a911382bc01 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:16.251847 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c16f4898-bc7d-4047-ac09-4a911382bc01 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:16.252279 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c16f4898-bc7d-4047-ac09-4a911382bc01 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:16.259021 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ea17e280-cb8e-4177-8ffd-bd4e5ce2a0f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.157577 Jun 24 08:42:16.263311 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 62/111] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:16 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:16.384342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c16f4898-bc7d-4047-ac09-4a911382bc01 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:16.392449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c16f4898-bc7d-4047-ac09-4a911382bc01 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:16.394243 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c16f4898-bc7d-4047-ac09-4a911382bc01 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:16.395457 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c16f4898-bc7d-4047-ac09-4a911382bc01 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.161218 Jun 24 08:42:16.396009 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 50/112] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:16 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:16.733583 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f9e39017-bbb1-44f9-b7ec-af5a4ef4ab39 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:16.734274 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f9e39017-bbb1-44f9-b7ec-af5a4ef4ab39 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:16.741638 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9e39017-bbb1-44f9-b7ec-af5a4ef4ab39 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:16.742343 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9e39017-bbb1-44f9-b7ec-af5a4ef4ab39 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:16.743283 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9e39017-bbb1-44f9-b7ec-af5a4ef4ab39 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:16.743781 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9e39017-bbb1-44f9-b7ec-af5a4ef4ab39 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:16.885726 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f9e39017-bbb1-44f9-b7ec-af5a4ef4ab39 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:16.893349 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f9e39017-bbb1-44f9-b7ec-af5a4ef4ab39 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.163493 Jun 24 08:42:16.904620 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 63/113] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:16 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:17.276930 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b2bcd71a-7479-410a-862f-a2d3eb00b97b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:17.277487 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b2bcd71a-7479-410a-862f-a2d3eb00b97b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:17.284873 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2bcd71a-7479-410a-862f-a2d3eb00b97b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:17.285325 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2bcd71a-7479-410a-862f-a2d3eb00b97b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:17.286390 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2bcd71a-7479-410a-862f-a2d3eb00b97b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:17.286539 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2bcd71a-7479-410a-862f-a2d3eb00b97b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:17.416012 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b1019cb6-c1a8-4d67-bb0b-87d7e406fd90 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:17.419959 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b1019cb6-c1a8-4d67-bb0b-87d7e406fd90 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:17.428484 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b1019cb6-c1a8-4d67-bb0b-87d7e406fd90 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:17.429273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b1019cb6-c1a8-4d67-bb0b-87d7e406fd90 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:17.430228 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b1019cb6-c1a8-4d67-bb0b-87d7e406fd90 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:17.430804 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b1019cb6-c1a8-4d67-bb0b-87d7e406fd90 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:17.438146 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:17.796201 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b2bcd71a-7479-410a-862f-a2d3eb00b97b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:17.809972 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b2bcd71a-7479-410a-862f-a2d3eb00b97b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.536820 Jun 24 08:42:17.810864 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 51/114] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:17 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:17.894200 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b1019cb6-c1a8-4d67-bb0b-87d7e406fd90 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:17.903838 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b1019cb6-c1a8-4d67-bb0b-87d7e406fd90 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:17.905540 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b1019cb6-c1a8-4d67-bb0b-87d7e406fd90 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:17.907028 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b1019cb6-c1a8-4d67-bb0b-87d7e406fd90 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.497379 Jun 24 08:42:17.908074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 64/115] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:17 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:17.910952 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-067b8261-feb3-453c-9215-76a42a6e6ed8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:17.911631 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-067b8261-feb3-453c-9215-76a42a6e6ed8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:17.918584 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-067b8261-feb3-453c-9215-76a42a6e6ed8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:17.919034 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-067b8261-feb3-453c-9215-76a42a6e6ed8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:17.919820 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-067b8261-feb3-453c-9215-76a42a6e6ed8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:17.920250 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-067b8261-feb3-453c-9215-76a42a6e6ed8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:18.051810 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-245940346", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "networks": [{"uuid": "ff7c78a0-23ea-4cbc-b1dd-1640d90bd5ab"}]}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:18.098324 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-067b8261-feb3-453c-9215-76a42a6e6ed8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:18.106781 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-067b8261-feb3-453c-9215-76a42a6e6ed8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.200516 Jun 24 08:42:18.107483 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 52/116] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:17 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:18.112986 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] validate_networks() for [('ff7c78a0-23ea-4cbc-b1dd-1640d90bd5ab', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:42:18.549705 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:42:18.550710 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:42:18.551237 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:42:18.551641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:42:18.552062 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:42:18.562335 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:18.562983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:18.563972 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:18.564563 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:18.585149 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Getting quotas for project 5e6d51dece9847669e9a666633ce634d. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:42:18.589485 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Getting quotas for user 46097d36b6fc4df5b510d279a4648eb7 and project 5e6d51dece9847669e9a666633ce634d. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:42:18.604252 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:42:18.607149 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:42:18.672071 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cbd82bfe-f04b-4132-b7ab-34ec57893087 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624314 Jun 24 08:42:18.672955 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 65/117] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:42:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:42:18.683506 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e69aae1f-3402-4806-8674-3c5aaac02bd6 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:18.684664 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e69aae1f-3402-4806-8674-3c5aaac02bd6 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:18.752350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e69aae1f-3402-4806-8674-3c5aaac02bd6 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:18.774287 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e69aae1f-3402-4806-8674-3c5aaac02bd6 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1213 microversion: 2.1 time: 0.094767 Jun 24 08:42:18.780057 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 53/118] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:18 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:18.829453 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0c1291ce-87ee-408a-bb18-939171c0ce62 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:18.830326 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0c1291ce-87ee-408a-bb18-939171c0ce62 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:18.838140 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0c1291ce-87ee-408a-bb18-939171c0ce62 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:18.838901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0c1291ce-87ee-408a-bb18-939171c0ce62 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:18.839893 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0c1291ce-87ee-408a-bb18-939171c0ce62 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:18.840911 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0c1291ce-87ee-408a-bb18-939171c0ce62 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:18.925727 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-21626589-3c0a-4536-a593-6a1660299b86 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:18.926961 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-21626589-3c0a-4536-a593-6a1660299b86 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:18.934137 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21626589-3c0a-4536-a593-6a1660299b86 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:18.934582 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21626589-3c0a-4536-a593-6a1660299b86 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:18.935559 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21626589-3c0a-4536-a593-6a1660299b86 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:18.936146 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-21626589-3c0a-4536-a593-6a1660299b86 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:19.107248 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0c1291ce-87ee-408a-bb18-939171c0ce62 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:19.116922 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0c1291ce-87ee-408a-bb18-939171c0ce62 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.292536 Jun 24 08:42:19.119898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 66/119] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:18 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:19.131632 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7acb3d96-149b-4133-8c75-513525fb34c0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:19.132580 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7acb3d96-149b-4133-8c75-513525fb34c0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:19.140821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7acb3d96-149b-4133-8c75-513525fb34c0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:19.141651 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7acb3d96-149b-4133-8c75-513525fb34c0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:19.142607 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7acb3d96-149b-4133-8c75-513525fb34c0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:19.143431 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7acb3d96-149b-4133-8c75-513525fb34c0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:19.323811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-21626589-3c0a-4536-a593-6a1660299b86 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:19.334198 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-21626589-3c0a-4536-a593-6a1660299b86 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:19.337898 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-21626589-3c0a-4536-a593-6a1660299b86 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:19.339027 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-21626589-3c0a-4536-a593-6a1660299b86 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.417200 Jun 24 08:42:19.350583 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 54/120] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:18 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:19.409260 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7acb3d96-149b-4133-8c75-513525fb34c0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:19.417438 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7acb3d96-149b-4133-8c75-513525fb34c0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.295780 Jun 24 08:42:19.419372 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 67/121] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:19 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:19.796777 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-963df786-0e7d-45b0-9c2a-3fc3459713a0 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:19.798433 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-963df786-0e7d-45b0-9c2a-3fc3459713a0 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:19.809997 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-963df786-0e7d-45b0-9c2a-3fc3459713a0 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:19.812006 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-963df786-0e7d-45b0-9c2a-3fc3459713a0 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:19.814178 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-963df786-0e7d-45b0-9c2a-3fc3459713a0 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:19.815073 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-963df786-0e7d-45b0-9c2a-3fc3459713a0 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:19.950782 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-963df786-0e7d-45b0-9c2a-3fc3459713a0 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:19.963009 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-963df786-0e7d-45b0-9c2a-3fc3459713a0 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1217 microversion: 2.1 time: 0.168416 Jun 24 08:42:19.973908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 55/122] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:19 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:20.139161 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-64e42acf-bd98-44b2-a6d8-2537a7e53a6c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:20.140635 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-64e42acf-bd98-44b2-a6d8-2537a7e53a6c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:20.182525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-64e42acf-bd98-44b2-a6d8-2537a7e53a6c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:20.183025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-64e42acf-bd98-44b2-a6d8-2537a7e53a6c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:20.183909 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-64e42acf-bd98-44b2-a6d8-2537a7e53a6c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:20.185278 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-64e42acf-bd98-44b2-a6d8-2537a7e53a6c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:20.358579 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5869eb67-c141-4545-911a-81aa2e03262f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:20.359410 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5869eb67-c141-4545-911a-81aa2e03262f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:20.368779 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5869eb67-c141-4545-911a-81aa2e03262f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:20.369468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5869eb67-c141-4545-911a-81aa2e03262f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:20.374287 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5869eb67-c141-4545-911a-81aa2e03262f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:20.374998 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5869eb67-c141-4545-911a-81aa2e03262f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:20.609952 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-64e42acf-bd98-44b2-a6d8-2537a7e53a6c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:20.620009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-64e42acf-bd98-44b2-a6d8-2537a7e53a6c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.486180 Jun 24 08:42:20.624719 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 68/123] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:20 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:20.641286 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-de188a7e-8da8-441f-8d05-f5e6b1ad2df4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:20.642215 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-de188a7e-8da8-441f-8d05-f5e6b1ad2df4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:20.652112 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-de188a7e-8da8-441f-8d05-f5e6b1ad2df4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:20.653308 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-de188a7e-8da8-441f-8d05-f5e6b1ad2df4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:20.655305 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-de188a7e-8da8-441f-8d05-f5e6b1ad2df4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:20.664091 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-de188a7e-8da8-441f-8d05-f5e6b1ad2df4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:20.666711 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5869eb67-c141-4545-911a-81aa2e03262f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:20.674952 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:20.683929 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5869eb67-c141-4545-911a-81aa2e03262f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:20.686922 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5869eb67-c141-4545-911a-81aa2e03262f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:20.690129 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5869eb67-c141-4545-911a-81aa2e03262f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.333983 Jun 24 08:42:20.691863 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 56/124] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:20 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:20.983709 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-45d185fa-bc4e-48dd-9adf-fcac367b33dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:20.986841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-45d185fa-bc4e-48dd-9adf-fcac367b33dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:21.009120 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-45d185fa-bc4e-48dd-9adf-fcac367b33dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:21.010352 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-45d185fa-bc4e-48dd-9adf-fcac367b33dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:21.013640 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-45d185fa-bc4e-48dd-9adf-fcac367b33dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:21.015029 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-45d185fa-bc4e-48dd-9adf-fcac367b33dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:21.365441 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-45d185fa-bc4e-48dd-9adf-fcac367b33dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:21.376471 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-45d185fa-bc4e-48dd-9adf-fcac367b33dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1271 microversion: 2.1 time: 0.399159 Jun 24 08:42:21.385974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 57/125] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:20 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1271 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:21.469835 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-de188a7e-8da8-441f-8d05-f5e6b1ad2df4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:21.479659 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-de188a7e-8da8-441f-8d05-f5e6b1ad2df4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.853632 Jun 24 08:42:21.489943 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 69/126] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:20 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:21.646130 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c9d7ab66-bf0c-48ac-949b-5670849934a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:21.651295 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c9d7ab66-bf0c-48ac-949b-5670849934a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:21.664010 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9d7ab66-bf0c-48ac-949b-5670849934a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:21.664464 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9d7ab66-bf0c-48ac-949b-5670849934a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:21.665303 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9d7ab66-bf0c-48ac-949b-5670849934a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:21.666140 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9d7ab66-bf0c-48ac-949b-5670849934a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:21.711333 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c9dc8c78-579d-44e4-b680-587ebba446d0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:21.712195 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c9dc8c78-579d-44e4-b680-587ebba446d0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:21.722276 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c9dc8c78-579d-44e4-b680-587ebba446d0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:21.722803 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c9dc8c78-579d-44e4-b680-587ebba446d0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:21.724390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c9dc8c78-579d-44e4-b680-587ebba446d0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:21.724977 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c9dc8c78-579d-44e4-b680-587ebba446d0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:21.894234 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c9d7ab66-bf0c-48ac-949b-5670849934a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:21.906126 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c9d7ab66-bf0c-48ac-949b-5670849934a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.264860 Jun 24 08:42:21.907125 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 58/127] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:21 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:21.947708 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c9dc8c78-579d-44e4-b680-587ebba446d0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:21.955922 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c9dc8c78-579d-44e4-b680-587ebba446d0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:21.957635 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c9dc8c78-579d-44e4-b680-587ebba446d0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:21.958933 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c9dc8c78-579d-44e4-b680-587ebba446d0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.253794 Jun 24 08:42:21.959880 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 70/128] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:21 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:22.398622 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-38da4405-8e3b-4321-ba10-28dfb786780f tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:22.400368 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-38da4405-8e3b-4321-ba10-28dfb786780f tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:22.402936 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:22.411488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-38da4405-8e3b-4321-ba10-28dfb786780f tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:22.412882 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-38da4405-8e3b-4321-ba10-28dfb786780f tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:22.414109 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-38da4405-8e3b-4321-ba10-28dfb786780f tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:22.414735 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-38da4405-8e3b-4321-ba10-28dfb786780f tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:22.496690 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-26c3f564-b902-473b-a44a-ea75d0a1820c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:22.497319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-26c3f564-b902-473b-a44a-ea75d0a1820c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:22.498856 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-38da4405-8e3b-4321-ba10-28dfb786780f tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:22.510342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-38da4405-8e3b-4321-ba10-28dfb786780f tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1271 microversion: 2.1 time: 0.119799 Jun 24 08:42:22.511028 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 59/129] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:22 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:22.518649 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26c3f564-b902-473b-a44a-ea75d0a1820c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:22.519412 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26c3f564-b902-473b-a44a-ea75d0a1820c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:22.520440 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26c3f564-b902-473b-a44a-ea75d0a1820c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:22.520878 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26c3f564-b902-473b-a44a-ea75d0a1820c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:22.725851 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-26c3f564-b902-473b-a44a-ea75d0a1820c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:22.736345 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-26c3f564-b902-473b-a44a-ea75d0a1820c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.243570 Jun 24 08:42:22.737231 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 71/130] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:22 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:22.769517 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-4dd32751-f6ca-40fc-ad5c-ebff42fe6ba5 req-af926254-2444-4340-ac5f-42d2d8fe8a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b5105a-20c5-4e33-b0d8-74b5033b5c38", "name": "network-vif-plugged", "status": "completed", "tag": "0c02d8f2-b51b-4f5e-a580-5a4e41ddb70b"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:22.792173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-4dd32751-f6ca-40fc-ad5c-ebff42fe6ba5 req-af926254-2444-4340-ac5f-42d2d8fe8a80 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:22.792627 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-4dd32751-f6ca-40fc-ad5c-ebff42fe6ba5 req-af926254-2444-4340-ac5f-42d2d8fe8a80 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:22.805619 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-4dd32751-f6ca-40fc-ad5c-ebff42fe6ba5 req-af926254-2444-4340-ac5f-42d2d8fe8a80 service nova] Creating event network-vif-plugged:0c02d8f2-b51b-4f5e-a580-5a4e41ddb70b for instance b1b5105a-20c5-4e33-b0d8-74b5033b5c38 on hv-cinder-84517 Jun 24 08:42:22.811349 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-4dd32751-f6ca-40fc-ad5c-ebff42fe6ba5 req-af926254-2444-4340-ac5f-42d2d8fe8a80 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.286669 Jun 24 08:42:22.811942 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 60/131] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:22.922410 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3e8f6c8a-652c-448a-ad40-8412957d75ba tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:22.923016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3e8f6c8a-652c-448a-ad40-8412957d75ba tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:22.929718 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3e8f6c8a-652c-448a-ad40-8412957d75ba tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:22.930380 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3e8f6c8a-652c-448a-ad40-8412957d75ba tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:22.931388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3e8f6c8a-652c-448a-ad40-8412957d75ba tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:22.931999 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3e8f6c8a-652c-448a-ad40-8412957d75ba tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:22.981509 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5a55c64b-17d7-416f-8e49-724e256b7b7b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:22.986445 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5a55c64b-17d7-416f-8e49-724e256b7b7b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:23.002087 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a55c64b-17d7-416f-8e49-724e256b7b7b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:23.002540 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a55c64b-17d7-416f-8e49-724e256b7b7b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:23.010319 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a55c64b-17d7-416f-8e49-724e256b7b7b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:23.011688 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5a55c64b-17d7-416f-8e49-724e256b7b7b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:23.150062 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3e8f6c8a-652c-448a-ad40-8412957d75ba tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:23.172977 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3e8f6c8a-652c-448a-ad40-8412957d75ba tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.254660 Jun 24 08:42:23.173765 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 72/132] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:22 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:23.228325 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5a55c64b-17d7-416f-8e49-724e256b7b7b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:23.237440 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5a55c64b-17d7-416f-8e49-724e256b7b7b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:23.240369 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5a55c64b-17d7-416f-8e49-724e256b7b7b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:23.242097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5a55c64b-17d7-416f-8e49-724e256b7b7b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.265997 Jun 24 08:42:23.243862 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 61/133] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:22 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:23.532288 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f2b6fa2c-4da0-44ac-9ddf-f755f8bac5da tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:23.544333 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f2b6fa2c-4da0-44ac-9ddf-f755f8bac5da tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:23.558544 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f2b6fa2c-4da0-44ac-9ddf-f755f8bac5da tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:23.559121 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f2b6fa2c-4da0-44ac-9ddf-f755f8bac5da tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:23.559993 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f2b6fa2c-4da0-44ac-9ddf-f755f8bac5da tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:23.560478 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f2b6fa2c-4da0-44ac-9ddf-f755f8bac5da tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:23.646601 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f2b6fa2c-4da0-44ac-9ddf-f755f8bac5da tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:23.654932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f2b6fa2c-4da0-44ac-9ddf-f755f8bac5da tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1271 microversion: 2.1 time: 0.130981 Jun 24 08:42:23.655762 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 73/134] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:23 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:23.755034 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-82e2ffef-1528-45c2-a59f-009101a29532 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:23.755719 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-82e2ffef-1528-45c2-a59f-009101a29532 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:23.762756 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82e2ffef-1528-45c2-a59f-009101a29532 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:23.763570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82e2ffef-1528-45c2-a59f-009101a29532 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:23.764521 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82e2ffef-1528-45c2-a59f-009101a29532 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:23.764953 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-82e2ffef-1528-45c2-a59f-009101a29532 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.019795 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-82e2ffef-1528-45c2-a59f-009101a29532 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:24.029103 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-82e2ffef-1528-45c2-a59f-009101a29532 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.279433 Jun 24 08:42:24.030260 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 62/135] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:23 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:24.191391 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3ce56ed2-1a50-482c-95ab-9cb82a87f017 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:24.192714 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3ce56ed2-1a50-482c-95ab-9cb82a87f017 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:24.199719 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3ce56ed2-1a50-482c-95ab-9cb82a87f017 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:24.200169 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3ce56ed2-1a50-482c-95ab-9cb82a87f017 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.201075 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3ce56ed2-1a50-482c-95ab-9cb82a87f017 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:24.201576 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3ce56ed2-1a50-482c-95ab-9cb82a87f017 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.260579 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e43ea6ce-ec91-49d7-8ef5-ea4a5ca186a7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:24.261193 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e43ea6ce-ec91-49d7-8ef5-ea4a5ca186a7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:24.268013 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e43ea6ce-ec91-49d7-8ef5-ea4a5ca186a7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:24.268614 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e43ea6ce-ec91-49d7-8ef5-ea4a5ca186a7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.269535 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e43ea6ce-ec91-49d7-8ef5-ea4a5ca186a7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:24.270357 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e43ea6ce-ec91-49d7-8ef5-ea4a5ca186a7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.404708 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3ce56ed2-1a50-482c-95ab-9cb82a87f017 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:24.414808 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3ce56ed2-1a50-482c-95ab-9cb82a87f017 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.228647 Jun 24 08:42:24.415536 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 74/136] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:24 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:24.436436 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e43ea6ce-ec91-49d7-8ef5-ea4a5ca186a7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:24.446423 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e43ea6ce-ec91-49d7-8ef5-ea4a5ca186a7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:24.448088 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e43ea6ce-ec91-49d7-8ef5-ea4a5ca186a7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:24.449398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e43ea6ce-ec91-49d7-8ef5-ea4a5ca186a7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.192650 Jun 24 08:42:24.450209 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 63/137] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:24 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:24.672485 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-09c58c02-38b9-413e-a572-7dfcd2ad236b tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:24.674246 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-09c58c02-38b9-413e-a572-7dfcd2ad236b tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:24.687636 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09c58c02-38b9-413e-a572-7dfcd2ad236b tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:24.688345 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09c58c02-38b9-413e-a572-7dfcd2ad236b tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.689455 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09c58c02-38b9-413e-a572-7dfcd2ad236b tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:24.689882 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09c58c02-38b9-413e-a572-7dfcd2ad236b tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.831964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-14e8c306-0347-4830-a96b-cf408e692c7a req-3417bea0-b015-4042-b267-430f79f8f925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47cbea2-c37b-437e-9f72-539dd1b59f53", "name": "network-vif-plugged", "status": "completed", "tag": "78906aae-6d64-4560-9fa5-15138c397c8f"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:24.841563 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-14e8c306-0347-4830-a96b-cf408e692c7a req-3417bea0-b015-4042-b267-430f79f8f925 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:24.842361 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-14e8c306-0347-4830-a96b-cf408e692c7a req-3417bea0-b015-4042-b267-430f79f8f925 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:24.855097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-14e8c306-0347-4830-a96b-cf408e692c7a req-3417bea0-b015-4042-b267-430f79f8f925 service nova] Creating event network-vif-plugged:78906aae-6d64-4560-9fa5-15138c397c8f for instance f47cbea2-c37b-437e-9f72-539dd1b59f53 on hv-cinder-84517 Jun 24 08:42:24.860732 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-09c58c02-38b9-413e-a572-7dfcd2ad236b tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:24.866984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-14e8c306-0347-4830-a96b-cf408e692c7a req-3417bea0-b015-4042-b267-430f79f8f925 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038241 Jun 24 08:42:24.868791 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 64/138] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:24.874568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-09c58c02-38b9-413e-a572-7dfcd2ad236b tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.205839 Jun 24 08:42:24.875638 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 75/139] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:24 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:25.052616 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-35e149c8-17e0-43d1-82b3-ae0ef7818f11 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:25.055089 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-35e149c8-17e0-43d1-82b3-ae0ef7818f11 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:25.064404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35e149c8-17e0-43d1-82b3-ae0ef7818f11 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:25.065352 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35e149c8-17e0-43d1-82b3-ae0ef7818f11 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:25.067964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35e149c8-17e0-43d1-82b3-ae0ef7818f11 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:25.068719 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-35e149c8-17e0-43d1-82b3-ae0ef7818f11 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:25.260658 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-35e149c8-17e0-43d1-82b3-ae0ef7818f11 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:25.273906 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-35e149c8-17e0-43d1-82b3-ae0ef7818f11 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.229980 Jun 24 08:42:25.274710 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 65/140] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:25 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:25.434408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-63eb0815-0978-4025-aef8-b229f068a474 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:25.435228 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-63eb0815-0978-4025-aef8-b229f068a474 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:25.445380 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-63eb0815-0978-4025-aef8-b229f068a474 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:25.445858 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-63eb0815-0978-4025-aef8-b229f068a474 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:25.446642 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-63eb0815-0978-4025-aef8-b229f068a474 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:25.447084 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-63eb0815-0978-4025-aef8-b229f068a474 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:25.468083 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c9e8a654-5f4e-4f7f-bccb-1dd8763c9a27 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:25.468782 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c9e8a654-5f4e-4f7f-bccb-1dd8763c9a27 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:25.476618 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9e8a654-5f4e-4f7f-bccb-1dd8763c9a27 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:25.477077 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9e8a654-5f4e-4f7f-bccb-1dd8763c9a27 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:25.477861 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9e8a654-5f4e-4f7f-bccb-1dd8763c9a27 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:25.478303 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9e8a654-5f4e-4f7f-bccb-1dd8763c9a27 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:25.653855 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-63eb0815-0978-4025-aef8-b229f068a474 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:25.662460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-63eb0815-0978-4025-aef8-b229f068a474 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.233736 Jun 24 08:42:25.663595 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 76/141] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:25 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:25.713511 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c9e8a654-5f4e-4f7f-bccb-1dd8763c9a27 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:25.722435 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c9e8a654-5f4e-4f7f-bccb-1dd8763c9a27 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:25.724753 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c9e8a654-5f4e-4f7f-bccb-1dd8763c9a27 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:25.726007 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c9e8a654-5f4e-4f7f-bccb-1dd8763c9a27 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.262370 Jun 24 08:42:25.726506 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 66/142] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:25 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:25.892965 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-04dd34f1-0296-4fae-aae5-9aa61acd7215 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:25.894023 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-04dd34f1-0296-4fae-aae5-9aa61acd7215 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:25.901977 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-04dd34f1-0296-4fae-aae5-9aa61acd7215 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:25.902614 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-04dd34f1-0296-4fae-aae5-9aa61acd7215 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:25.903549 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-04dd34f1-0296-4fae-aae5-9aa61acd7215 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:25.904254 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-04dd34f1-0296-4fae-aae5-9aa61acd7215 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:26.066348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-04dd34f1-0296-4fae-aae5-9aa61acd7215 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:26.080962 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-04dd34f1-0296-4fae-aae5-9aa61acd7215 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.192790 Jun 24 08:42:26.081549 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 77/143] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:25 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:26.292615 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e0d08994-8f78-4ce1-94af-8084965832db tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:26.293859 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e0d08994-8f78-4ce1-94af-8084965832db tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:26.301087 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0d08994-8f78-4ce1-94af-8084965832db tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:26.301596 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0d08994-8f78-4ce1-94af-8084965832db tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:26.302365 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0d08994-8f78-4ce1-94af-8084965832db tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:26.302797 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0d08994-8f78-4ce1-94af-8084965832db tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:26.510580 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e0d08994-8f78-4ce1-94af-8084965832db tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:26.518601 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e0d08994-8f78-4ce1-94af-8084965832db tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.231055 Jun 24 08:42:26.519175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 67/144] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:26 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:26.682050 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0a226890-cc07-4ff0-a513-3cb1555e3c13 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:26.682949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0a226890-cc07-4ff0-a513-3cb1555e3c13 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:26.689255 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0a226890-cc07-4ff0-a513-3cb1555e3c13 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:26.689920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0a226890-cc07-4ff0-a513-3cb1555e3c13 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:26.690804 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0a226890-cc07-4ff0-a513-3cb1555e3c13 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:26.691502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0a226890-cc07-4ff0-a513-3cb1555e3c13 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:26.746205 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-222f5df7-679e-4b89-9fd0-8422d1bf450b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:26.746816 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-222f5df7-679e-4b89-9fd0-8422d1bf450b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:26.753685 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-222f5df7-679e-4b89-9fd0-8422d1bf450b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:26.754144 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-222f5df7-679e-4b89-9fd0-8422d1bf450b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:26.755527 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-222f5df7-679e-4b89-9fd0-8422d1bf450b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:26.755962 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-222f5df7-679e-4b89-9fd0-8422d1bf450b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:26.929930 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0a226890-cc07-4ff0-a513-3cb1555e3c13 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:26.940724 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0a226890-cc07-4ff0-a513-3cb1555e3c13 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.264088 Jun 24 08:42:26.947902 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 78/145] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:26 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:26.996798 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-222f5df7-679e-4b89-9fd0-8422d1bf450b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:27.007292 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-222f5df7-679e-4b89-9fd0-8422d1bf450b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:27.008939 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-222f5df7-679e-4b89-9fd0-8422d1bf450b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:27.010071 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-222f5df7-679e-4b89-9fd0-8422d1bf450b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.270519 Jun 24 08:42:27.010631 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 68/146] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:26 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:27.097985 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ac58ed95-20fa-49f9-a912-e5711179b756 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:27.099147 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ac58ed95-20fa-49f9-a912-e5711179b756 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:27.106856 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ac58ed95-20fa-49f9-a912-e5711179b756 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:27.107656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ac58ed95-20fa-49f9-a912-e5711179b756 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:27.109325 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ac58ed95-20fa-49f9-a912-e5711179b756 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:27.110092 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ac58ed95-20fa-49f9-a912-e5711179b756 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:27.273450 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ac58ed95-20fa-49f9-a912-e5711179b756 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:27.284924 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ac58ed95-20fa-49f9-a912-e5711179b756 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.190711 Jun 24 08:42:27.286232 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 79/147] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:27 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:27.535137 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7d570788-ecb1-47b7-aec9-7b345c1f87c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:27.535793 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7d570788-ecb1-47b7-aec9-7b345c1f87c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:27.543389 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d570788-ecb1-47b7-aec9-7b345c1f87c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:27.543838 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d570788-ecb1-47b7-aec9-7b345c1f87c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:27.544632 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d570788-ecb1-47b7-aec9-7b345c1f87c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:27.545302 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7d570788-ecb1-47b7-aec9-7b345c1f87c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:27.702164 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7d570788-ecb1-47b7-aec9-7b345c1f87c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:27.716414 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7d570788-ecb1-47b7-aec9-7b345c1f87c2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.185407 Jun 24 08:42:27.717836 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 69/148] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:27 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:27.963796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-17e1371d-199a-463d-8c2f-06f17f82a01b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:27.964492 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-17e1371d-199a-463d-8c2f-06f17f82a01b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:27.970878 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-17e1371d-199a-463d-8c2f-06f17f82a01b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:27.971346 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-17e1371d-199a-463d-8c2f-06f17f82a01b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:27.972105 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-17e1371d-199a-463d-8c2f-06f17f82a01b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:27.972530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-17e1371d-199a-463d-8c2f-06f17f82a01b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:28.028281 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7b34ea58-29fd-4d48-8e4a-8effa21eda16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:28.029123 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7b34ea58-29fd-4d48-8e4a-8effa21eda16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:28.035073 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b34ea58-29fd-4d48-8e4a-8effa21eda16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:28.035877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b34ea58-29fd-4d48-8e4a-8effa21eda16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:28.036846 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b34ea58-29fd-4d48-8e4a-8effa21eda16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:28.037422 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b34ea58-29fd-4d48-8e4a-8effa21eda16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:28.185465 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-17e1371d-199a-463d-8c2f-06f17f82a01b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:28.193354 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-17e1371d-199a-463d-8c2f-06f17f82a01b tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.233828 Jun 24 08:42:28.203845 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 80/149] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:27 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:28.233548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7b34ea58-29fd-4d48-8e4a-8effa21eda16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:28.244801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7b34ea58-29fd-4d48-8e4a-8effa21eda16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:28.247745 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7b34ea58-29fd-4d48-8e4a-8effa21eda16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:28.249098 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7b34ea58-29fd-4d48-8e4a-8effa21eda16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.224620 Jun 24 08:42:28.249658 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 70/150] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:28 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:28.305651 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-67eebbce-5bc8-4b5b-b98f-d6292a6fd24a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:28.307096 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-67eebbce-5bc8-4b5b-b98f-d6292a6fd24a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:28.314722 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-67eebbce-5bc8-4b5b-b98f-d6292a6fd24a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:28.315707 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-67eebbce-5bc8-4b5b-b98f-d6292a6fd24a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:28.316701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-67eebbce-5bc8-4b5b-b98f-d6292a6fd24a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:28.318394 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-67eebbce-5bc8-4b5b-b98f-d6292a6fd24a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:28.338743 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:28.469404 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-67eebbce-5bc8-4b5b-b98f-d6292a6fd24a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:28.478361 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-67eebbce-5bc8-4b5b-b98f-d6292a6fd24a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.178149 Jun 24 08:42:28.479173 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 81/151] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:28 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:28.735244 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5ada5dea-2c37-4808-83ca-c632552e4c83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:28.735980 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5ada5dea-2c37-4808-83ca-c632552e4c83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:28.747075 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ada5dea-2c37-4808-83ca-c632552e4c83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:28.747998 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ada5dea-2c37-4808-83ca-c632552e4c83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:28.749081 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ada5dea-2c37-4808-83ca-c632552e4c83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:28.749634 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5ada5dea-2c37-4808-83ca-c632552e4c83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:28.776225 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:28.930285 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5ada5dea-2c37-4808-83ca-c632552e4c83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:28.941175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5ada5dea-2c37-4808-83ca-c632552e4c83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.210399 Jun 24 08:42:28.942742 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 71/152] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:28 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:29.214990 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f1779a2a-a0a9-465a-8321-012be33cdb85 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:29.216534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f1779a2a-a0a9-465a-8321-012be33cdb85 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:29.218807 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:29.219588 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=6 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:29.226466 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1779a2a-a0a9-465a-8321-012be33cdb85 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:29.226984 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1779a2a-a0a9-465a-8321-012be33cdb85 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:29.228098 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1779a2a-a0a9-465a-8321-012be33cdb85 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:29.228604 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f1779a2a-a0a9-465a-8321-012be33cdb85 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:29.268543 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bf6ab7d8-0614-4d49-b5e8-dc7bb6d1ca6e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:29.269476 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bf6ab7d8-0614-4d49-b5e8-dc7bb6d1ca6e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:29.280067 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf6ab7d8-0614-4d49-b5e8-dc7bb6d1ca6e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:29.283449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf6ab7d8-0614-4d49-b5e8-dc7bb6d1ca6e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:29.284583 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf6ab7d8-0614-4d49-b5e8-dc7bb6d1ca6e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:29.285122 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bf6ab7d8-0614-4d49-b5e8-dc7bb6d1ca6e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:29.430862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f1779a2a-a0a9-465a-8321-012be33cdb85 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:29.450653 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f1779a2a-a0a9-465a-8321-012be33cdb85 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.244175 Jun 24 08:42:29.451281 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 82/153] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:29 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:29.455442 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bf6ab7d8-0614-4d49-b5e8-dc7bb6d1ca6e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:29.464669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bf6ab7d8-0614-4d49-b5e8-dc7bb6d1ca6e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:29.466182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bf6ab7d8-0614-4d49-b5e8-dc7bb6d1ca6e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:29.467321 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bf6ab7d8-0614-4d49-b5e8-dc7bb6d1ca6e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.203404 Jun 24 08:42:29.468155 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 72/154] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:29 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:29.496685 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b2c74488-167d-4d31-8b70-cb8567f31283 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:29.497072 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b2c74488-167d-4d31-8b70-cb8567f31283 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:29.499074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:29.505004 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2c74488-167d-4d31-8b70-cb8567f31283 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:29.505455 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2c74488-167d-4d31-8b70-cb8567f31283 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:29.506221 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2c74488-167d-4d31-8b70-cb8567f31283 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:29.506661 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2c74488-167d-4d31-8b70-cb8567f31283 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:29.638837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b2c74488-167d-4d31-8b70-cb8567f31283 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:29.648359 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b2c74488-167d-4d31-8b70-cb8567f31283 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.155777 Jun 24 08:42:29.648942 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 83/155] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:29 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:29.960145 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-07f7d71f-4a0c-46cd-ac84-ea33749e80cb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:29.960672 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-07f7d71f-4a0c-46cd-ac84-ea33749e80cb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:29.966717 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07f7d71f-4a0c-46cd-ac84-ea33749e80cb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:29.967165 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07f7d71f-4a0c-46cd-ac84-ea33749e80cb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:29.967961 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07f7d71f-4a0c-46cd-ac84-ea33749e80cb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:29.968398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07f7d71f-4a0c-46cd-ac84-ea33749e80cb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:30.096140 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-07f7d71f-4a0c-46cd-ac84-ea33749e80cb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:30.103399 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-07f7d71f-4a0c-46cd-ac84-ea33749e80cb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.147809 Jun 24 08:42:30.103954 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 73/156] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:29 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:30.468103 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f694dadb-d3b1-4f13-869f-cc092b6796df tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:30.468756 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f694dadb-d3b1-4f13-869f-cc092b6796df tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:30.475491 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f694dadb-d3b1-4f13-869f-cc092b6796df tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:30.475935 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f694dadb-d3b1-4f13-869f-cc092b6796df tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:30.476688 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f694dadb-d3b1-4f13-869f-cc092b6796df tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:30.477116 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f694dadb-d3b1-4f13-869f-cc092b6796df tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:30.487087 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-525f9da4-510d-4855-b80f-ac0e6fc9fed0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:30.487841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-525f9da4-510d-4855-b80f-ac0e6fc9fed0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:30.494444 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-525f9da4-510d-4855-b80f-ac0e6fc9fed0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:30.494716 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-525f9da4-510d-4855-b80f-ac0e6fc9fed0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:30.495518 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-525f9da4-510d-4855-b80f-ac0e6fc9fed0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:30.495981 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-525f9da4-510d-4855-b80f-ac0e6fc9fed0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:30.671825 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f694dadb-d3b1-4f13-869f-cc092b6796df tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:30.675381 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-525f9da4-510d-4855-b80f-ac0e6fc9fed0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:30.679315 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:30.680244 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f694dadb-d3b1-4f13-869f-cc092b6796df tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.215912 Jun 24 08:42:30.680979 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 84/157] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:30 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:30.685241 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-525f9da4-510d-4855-b80f-ac0e6fc9fed0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:30.685634 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a713f323-085a-46f9-9d3e-e142a0b03bad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:30.686309 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a713f323-085a-46f9-9d3e-e142a0b03bad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:30.686778 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-525f9da4-510d-4855-b80f-ac0e6fc9fed0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:30.687898 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-525f9da4-510d-4855-b80f-ac0e6fc9fed0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.204658 Jun 24 08:42:30.688436 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 74/158] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:30 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:30.692232 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a713f323-085a-46f9-9d3e-e142a0b03bad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:30.692670 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a713f323-085a-46f9-9d3e-e142a0b03bad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:30.693419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a713f323-085a-46f9-9d3e-e142a0b03bad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:30.693843 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a713f323-085a-46f9-9d3e-e142a0b03bad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:30.821008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a713f323-085a-46f9-9d3e-e142a0b03bad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:30.828447 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a713f323-085a-46f9-9d3e-e142a0b03bad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.146472 Jun 24 08:42:30.829007 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 85/159] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:30 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:31.120693 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-94acf7ba-ee43-4741-8466-dc118a8c4eba tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:31.121293 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-94acf7ba-ee43-4741-8466-dc118a8c4eba tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:31.127199 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94acf7ba-ee43-4741-8466-dc118a8c4eba tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:31.127698 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94acf7ba-ee43-4741-8466-dc118a8c4eba tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:31.128452 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94acf7ba-ee43-4741-8466-dc118a8c4eba tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:31.128876 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-94acf7ba-ee43-4741-8466-dc118a8c4eba tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:31.262180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-94acf7ba-ee43-4741-8466-dc118a8c4eba tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:31.270730 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-94acf7ba-ee43-4741-8466-dc118a8c4eba tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.153336 Jun 24 08:42:31.271354 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 75/160] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:31 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:31.697176 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e8fa9255-f5a1-4a1b-ab61-a923b5818404 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:31.697788 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e8fa9255-f5a1-4a1b-ab61-a923b5818404 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:31.703906 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e8fa9255-f5a1-4a1b-ab61-a923b5818404 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:31.704353 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e8fa9255-f5a1-4a1b-ab61-a923b5818404 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:31.705116 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e8fa9255-f5a1-4a1b-ab61-a923b5818404 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:31.705547 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e8fa9255-f5a1-4a1b-ab61-a923b5818404 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:31.705945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ae37ed6d-4d09-41f4-8730-c0f83ae126eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:31.706636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ae37ed6d-4d09-41f4-8730-c0f83ae126eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:31.712789 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae37ed6d-4d09-41f4-8730-c0f83ae126eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:31.713322 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae37ed6d-4d09-41f4-8730-c0f83ae126eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:31.714097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae37ed6d-4d09-41f4-8730-c0f83ae126eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:31.714535 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ae37ed6d-4d09-41f4-8730-c0f83ae126eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:31.899000 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e8fa9255-f5a1-4a1b-ab61-a923b5818404 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:31.902245 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ae37ed6d-4d09-41f4-8730-c0f83ae126eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:31.906389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e8fa9255-f5a1-4a1b-ab61-a923b5818404 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.213063 Jun 24 08:42:31.906953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 86/161] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:31 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:31.910191 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ae37ed6d-4d09-41f4-8730-c0f83ae126eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:31.911388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-69d96bc2-855d-462d-bc63-0abfdf3b44cb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:31.911957 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ae37ed6d-4d09-41f4-8730-c0f83ae126eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:31.912066 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-69d96bc2-855d-462d-bc63-0abfdf3b44cb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:31.913067 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ae37ed6d-4d09-41f4-8730-c0f83ae126eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.211269 Jun 24 08:42:31.913757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 76/162] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:31 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:31.920376 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69d96bc2-855d-462d-bc63-0abfdf3b44cb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:31.920829 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69d96bc2-855d-462d-bc63-0abfdf3b44cb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:31.921593 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69d96bc2-855d-462d-bc63-0abfdf3b44cb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:31.922033 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69d96bc2-855d-462d-bc63-0abfdf3b44cb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:32.051141 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-69d96bc2-855d-462d-bc63-0abfdf3b44cb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:32.059030 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-69d96bc2-855d-462d-bc63-0abfdf3b44cb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.151105 Jun 24 08:42:32.059623 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 87/163] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:31 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:32.287622 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-050ef840-5f20-41a6-ad79-0b4d7c92d7e5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:32.288231 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-050ef840-5f20-41a6-ad79-0b4d7c92d7e5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:32.294320 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-050ef840-5f20-41a6-ad79-0b4d7c92d7e5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:32.294769 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-050ef840-5f20-41a6-ad79-0b4d7c92d7e5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:32.295548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-050ef840-5f20-41a6-ad79-0b4d7c92d7e5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:32.295984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-050ef840-5f20-41a6-ad79-0b4d7c92d7e5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:32.422563 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-050ef840-5f20-41a6-ad79-0b4d7c92d7e5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:32.430027 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-050ef840-5f20-41a6-ad79-0b4d7c92d7e5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.146701 Jun 24 08:42:32.430654 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 77/164] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:32 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:32.923161 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ddaba676-e222-4b28-a716-e37271babdb4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:32.923812 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ddaba676-e222-4b28-a716-e37271babdb4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:32.930449 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ddaba676-e222-4b28-a716-e37271babdb4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:32.930896 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ddaba676-e222-4b28-a716-e37271babdb4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:32.931678 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ddaba676-e222-4b28-a716-e37271babdb4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:32.931891 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f87ac8c4-9424-43a3-998f-30723ef07f70 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:32.932107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ddaba676-e222-4b28-a716-e37271babdb4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:32.932503 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f87ac8c4-9424-43a3-998f-30723ef07f70 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:32.938470 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f87ac8c4-9424-43a3-998f-30723ef07f70 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:32.938930 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f87ac8c4-9424-43a3-998f-30723ef07f70 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:32.939811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f87ac8c4-9424-43a3-998f-30723ef07f70 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:32.940264 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f87ac8c4-9424-43a3-998f-30723ef07f70 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:33.122332 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ddaba676-e222-4b28-a716-e37271babdb4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:33.127325 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f87ac8c4-9424-43a3-998f-30723ef07f70 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:33.131057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ddaba676-e222-4b28-a716-e37271babdb4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.211657 Jun 24 08:42:33.131677 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 88/165] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:32 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:33.136167 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f87ac8c4-9424-43a3-998f-30723ef07f70 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:33.136322 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-59b6875b-9dc0-48d0-815b-2c6b1f3bb3d4 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:33.136836 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-59b6875b-9dc0-48d0-815b-2c6b1f3bb3d4 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:33.138250 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f87ac8c4-9424-43a3-998f-30723ef07f70 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:33.139563 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f87ac8c4-9424-43a3-998f-30723ef07f70 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.211653 Jun 24 08:42:33.140266 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 78/166] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:32 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:33.142826 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59b6875b-9dc0-48d0-815b-2c6b1f3bb3d4 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:33.143438 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59b6875b-9dc0-48d0-815b-2c6b1f3bb3d4 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:33.144212 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59b6875b-9dc0-48d0-815b-2c6b1f3bb3d4 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:33.144645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59b6875b-9dc0-48d0-815b-2c6b1f3bb3d4 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:33.274762 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-59b6875b-9dc0-48d0-815b-2c6b1f3bb3d4 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:33.282277 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-59b6875b-9dc0-48d0-815b-2c6b1f3bb3d4 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.149651 Jun 24 08:42:33.282844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 89/167] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:33 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:33.447085 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0266aa29-3779-4ad3-abba-cd32359f0f36 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:33.447984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0266aa29-3779-4ad3-abba-cd32359f0f36 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:33.454826 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0266aa29-3779-4ad3-abba-cd32359f0f36 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:33.455305 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0266aa29-3779-4ad3-abba-cd32359f0f36 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:33.456282 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0266aa29-3779-4ad3-abba-cd32359f0f36 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:33.456950 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0266aa29-3779-4ad3-abba-cd32359f0f36 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:33.659063 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0266aa29-3779-4ad3-abba-cd32359f0f36 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:33.668610 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0266aa29-3779-4ad3-abba-cd32359f0f36 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.226524 Jun 24 08:42:33.669670 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 79/168] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:33 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:34.086231 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-502c7964-973f-477c-bac2-b2e7c967cbc9 req-624d1962-a891-48db-be18-7402ca6b5edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9", "name": "network-vif-plugged", "status": "completed", "tag": "b4f1fb4a-3774-4faf-a4f3-7df9149cb8e7"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:34.097847 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-502c7964-973f-477c-bac2-b2e7c967cbc9 req-624d1962-a891-48db-be18-7402ca6b5edb service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:34.099086 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-502c7964-973f-477c-bac2-b2e7c967cbc9 req-624d1962-a891-48db-be18-7402ca6b5edb service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:34.117717 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-502c7964-973f-477c-bac2-b2e7c967cbc9 req-624d1962-a891-48db-be18-7402ca6b5edb service nova] Creating event network-vif-plugged:b4f1fb4a-3774-4faf-a4f3-7df9149cb8e7 for instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 on hv-cinder-84517 Jun 24 08:42:34.125865 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-502c7964-973f-477c-bac2-b2e7c967cbc9 req-624d1962-a891-48db-be18-7402ca6b5edb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043573 Jun 24 08:42:34.127944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 90/169] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:34.149383 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9dadfa0d-dd06-4afe-9e1e-b2d7abbd856e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:34.149966 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9dadfa0d-dd06-4afe-9e1e-b2d7abbd856e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:34.185532 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dadfa0d-dd06-4afe-9e1e-b2d7abbd856e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:34.185915 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dadfa0d-dd06-4afe-9e1e-b2d7abbd856e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:34.189561 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dadfa0d-dd06-4afe-9e1e-b2d7abbd856e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:34.190067 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dadfa0d-dd06-4afe-9e1e-b2d7abbd856e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:34.205022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-003b417c-649a-437b-bc80-19a95a7965c0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:34.205902 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-003b417c-649a-437b-bc80-19a95a7965c0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:34.220617 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-003b417c-649a-437b-bc80-19a95a7965c0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:34.225845 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-003b417c-649a-437b-bc80-19a95a7965c0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:34.226521 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-003b417c-649a-437b-bc80-19a95a7965c0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:34.227151 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-003b417c-649a-437b-bc80-19a95a7965c0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:34.469286 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9dadfa0d-dd06-4afe-9e1e-b2d7abbd856e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:34.474576 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-003b417c-649a-437b-bc80-19a95a7965c0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:34.477304 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9dadfa0d-dd06-4afe-9e1e-b2d7abbd856e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.332379 Jun 24 08:42:34.478182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 80/170] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:34 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:34.483107 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-78c81c39-db7e-4761-9e89-e5e265ab9016 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:34.483877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-78c81c39-db7e-4761-9e89-e5e265ab9016 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:34.491448 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-78c81c39-db7e-4761-9e89-e5e265ab9016 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:34.492060 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-78c81c39-db7e-4761-9e89-e5e265ab9016 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:34.492228 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-003b417c-649a-437b-bc80-19a95a7965c0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:34.493138 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-78c81c39-db7e-4761-9e89-e5e265ab9016 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:34.493725 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-78c81c39-db7e-4761-9e89-e5e265ab9016 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:34.493840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-003b417c-649a-437b-bc80-19a95a7965c0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:34.494832 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-003b417c-649a-437b-bc80-19a95a7965c0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.337822 Jun 24 08:42:34.495560 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 91/171] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:34 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:34.510286 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-7c98bbf8-d918-4ad4-bbaa-74c4171df609 req-d620c2f2-2af3-4f7a-a61e-0bcdfc524546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e95bd72b-348c-451a-91f9-a6c57e78f0ab", "tag": "afc37d28-9803-437f-a7be-97c7b873c3e9"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:34.522019 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-7c98bbf8-d918-4ad4-bbaa-74c4171df609 req-d620c2f2-2af3-4f7a-a61e-0bcdfc524546 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:34.522533 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-7c98bbf8-d918-4ad4-bbaa-74c4171df609 req-d620c2f2-2af3-4f7a-a61e-0bcdfc524546 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:34.550436 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-7c98bbf8-d918-4ad4-bbaa-74c4171df609 req-d620c2f2-2af3-4f7a-a61e-0bcdfc524546 service nova] Creating event network-changed:afc37d28-9803-437f-a7be-97c7b873c3e9 for instance e95bd72b-348c-451a-91f9-a6c57e78f0ab on hv-cinder-84517 Jun 24 08:42:34.559231 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-7c98bbf8-d918-4ad4-bbaa-74c4171df609 req-d620c2f2-2af3-4f7a-a61e-0bcdfc524546 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052728 Jun 24 08:42:34.559938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 92/172] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:34.640351 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-78c81c39-db7e-4761-9e89-e5e265ab9016 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:34.650919 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-78c81c39-db7e-4761-9e89-e5e265ab9016 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.171183 Jun 24 08:42:34.651538 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 81/173] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:34 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:34.688379 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-fc6a67d0-4e96-407b-9e09-3377e63de32e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:34.689448 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-fc6a67d0-4e96-407b-9e09-3377e63de32e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:34.696243 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fc6a67d0-4e96-407b-9e09-3377e63de32e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:34.696923 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fc6a67d0-4e96-407b-9e09-3377e63de32e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:34.697843 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fc6a67d0-4e96-407b-9e09-3377e63de32e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:34.698467 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fc6a67d0-4e96-407b-9e09-3377e63de32e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:34.844704 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-fc6a67d0-4e96-407b-9e09-3377e63de32e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:34.853145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-fc6a67d0-4e96-407b-9e09-3377e63de32e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.169324 Jun 24 08:42:34.853705 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 93/174] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:34 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:35.494444 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2ab77d1a-b3bd-4307-97b9-008570f8eb4e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:35.495078 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2ab77d1a-b3bd-4307-97b9-008570f8eb4e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:35.501737 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ab77d1a-b3bd-4307-97b9-008570f8eb4e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:35.502191 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ab77d1a-b3bd-4307-97b9-008570f8eb4e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:35.502954 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ab77d1a-b3bd-4307-97b9-008570f8eb4e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:35.503425 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ab77d1a-b3bd-4307-97b9-008570f8eb4e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:35.512633 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f2c2cf39-8658-4871-aaa2-ef53dc9d78f5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:35.513243 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f2c2cf39-8658-4871-aaa2-ef53dc9d78f5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:35.519245 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f2c2cf39-8658-4871-aaa2-ef53dc9d78f5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:35.519713 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f2c2cf39-8658-4871-aaa2-ef53dc9d78f5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:35.521030 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f2c2cf39-8658-4871-aaa2-ef53dc9d78f5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:35.521672 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f2c2cf39-8658-4871-aaa2-ef53dc9d78f5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:35.712161 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2ab77d1a-b3bd-4307-97b9-008570f8eb4e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:35.719495 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f2c2cf39-8658-4871-aaa2-ef53dc9d78f5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:35.725444 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2ab77d1a-b3bd-4307-97b9-008570f8eb4e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.235187 Jun 24 08:42:35.729723 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 82/175] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:35 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:35.736018 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f2c2cf39-8658-4871-aaa2-ef53dc9d78f5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:35.738355 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f2c2cf39-8658-4871-aaa2-ef53dc9d78f5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:35.745017 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-afdbdd50-6451-4e8e-bae4-2d70e3547aad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:35.745830 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-afdbdd50-6451-4e8e-bae4-2d70e3547aad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:35.748802 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f2c2cf39-8658-4871-aaa2-ef53dc9d78f5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.231626 Jun 24 08:42:35.749575 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 94/176] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:35 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:35.752625 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-afdbdd50-6451-4e8e-bae4-2d70e3547aad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:35.753068 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-afdbdd50-6451-4e8e-bae4-2d70e3547aad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:35.753820 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-afdbdd50-6451-4e8e-bae4-2d70e3547aad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:35.754393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-afdbdd50-6451-4e8e-bae4-2d70e3547aad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:35.871060 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-68e24145-289b-4b7f-9c41-404269f7b7bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:35.871712 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-68e24145-289b-4b7f-9c41-404269f7b7bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:35.878331 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68e24145-289b-4b7f-9c41-404269f7b7bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:35.878788 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68e24145-289b-4b7f-9c41-404269f7b7bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:35.879628 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68e24145-289b-4b7f-9c41-404269f7b7bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:35.880063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68e24145-289b-4b7f-9c41-404269f7b7bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:36.021833 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-afdbdd50-6451-4e8e-bae4-2d70e3547aad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:36.031492 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-afdbdd50-6451-4e8e-bae4-2d70e3547aad tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.300579 Jun 24 08:42:36.032308 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 83/177] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:35 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:36.103276 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-68e24145-289b-4b7f-9c41-404269f7b7bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:36.111422 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-68e24145-289b-4b7f-9c41-404269f7b7bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.244661 Jun 24 08:42:36.112305 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 95/178] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:35 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:36.169930 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-ea83f711-9612-416a-bc7e-dc2bcc384c49 req-8a6bd07e-20da-4ba1-912b-eab90d16214c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f6b0e38-4e81-4595-9acd-ec8335bb5db5", "name": "network-vif-plugged", "status": "completed", "tag": "6c3b5569-2019-4bad-bd54-dc7ff5e8c6b1"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:36.181146 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-ea83f711-9612-416a-bc7e-dc2bcc384c49 req-8a6bd07e-20da-4ba1-912b-eab90d16214c service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:36.182151 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-ea83f711-9612-416a-bc7e-dc2bcc384c49 req-8a6bd07e-20da-4ba1-912b-eab90d16214c service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:36.199739 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-ea83f711-9612-416a-bc7e-dc2bcc384c49 req-8a6bd07e-20da-4ba1-912b-eab90d16214c service nova] Creating event network-vif-plugged:6c3b5569-2019-4bad-bd54-dc7ff5e8c6b1 for instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 on hv-cinder-84517 Jun 24 08:42:36.209398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-ea83f711-9612-416a-bc7e-dc2bcc384c49 req-8a6bd07e-20da-4ba1-912b-eab90d16214c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049059 Jun 24 08:42:36.215312 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 84/179] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:36.747601 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-35d91b7c-b667-46b4-b797-13d743ed759c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:36.748227 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-35d91b7c-b667-46b4-b797-13d743ed759c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:36.754217 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-35d91b7c-b667-46b4-b797-13d743ed759c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:36.754658 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-35d91b7c-b667-46b4-b797-13d743ed759c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:36.755621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-35d91b7c-b667-46b4-b797-13d743ed759c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:36.756055 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-35d91b7c-b667-46b4-b797-13d743ed759c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:36.767921 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-20e862fd-487d-4742-9476-fc1067df12ab tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:36.770709 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-20e862fd-487d-4742-9476-fc1067df12ab tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:36.780067 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20e862fd-487d-4742-9476-fc1067df12ab tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:36.780982 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20e862fd-487d-4742-9476-fc1067df12ab tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:36.782173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20e862fd-487d-4742-9476-fc1067df12ab tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:36.782968 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-20e862fd-487d-4742-9476-fc1067df12ab tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:37.034551 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-20e862fd-487d-4742-9476-fc1067df12ab tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:37.037030 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-35d91b7c-b667-46b4-b797-13d743ed759c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:37.044494 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-20e862fd-487d-4742-9476-fc1067df12ab tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:37.046273 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-20e862fd-487d-4742-9476-fc1067df12ab tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:37.047417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-35d91b7c-b667-46b4-b797-13d743ed759c tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1315 microversion: 2.1 time: 0.304195 Jun 24 08:42:37.047997 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 96/180] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:36 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:37.057481 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ba838f36-bb08-458a-8b81-e5cbe2e07a24 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:37.057481 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ba838f36-bb08-458a-8b81-e5cbe2e07a24 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:37.058167 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-20e862fd-487d-4742-9476-fc1067df12ab tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.284866 Jun 24 08:42:37.059201 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 85/181] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:36 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:37.067398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ba838f36-bb08-458a-8b81-e5cbe2e07a24 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:37.067398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ba838f36-bb08-458a-8b81-e5cbe2e07a24 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:37.067398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ba838f36-bb08-458a-8b81-e5cbe2e07a24 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:37.067398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ba838f36-bb08-458a-8b81-e5cbe2e07a24 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:37.130799 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-44b0fc90-a1e2-4e67-b66b-1de2614a37dd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:37.131531 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-44b0fc90-a1e2-4e67-b66b-1de2614a37dd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:37.138726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44b0fc90-a1e2-4e67-b66b-1de2614a37dd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:37.139262 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44b0fc90-a1e2-4e67-b66b-1de2614a37dd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:37.149172 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44b0fc90-a1e2-4e67-b66b-1de2614a37dd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:37.149172 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44b0fc90-a1e2-4e67-b66b-1de2614a37dd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:37.252853 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ba838f36-bb08-458a-8b81-e5cbe2e07a24 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:37.264862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ba838f36-bb08-458a-8b81-e5cbe2e07a24 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.215695 Jun 24 08:42:37.266099 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 97/182] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:37 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:37.336700 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-44b0fc90-a1e2-4e67-b66b-1de2614a37dd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:37.349630 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-44b0fc90-a1e2-4e67-b66b-1de2614a37dd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1320 microversion: 2.1 time: 0.224320 Jun 24 08:42:37.360317 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 86/183] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:37 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1320 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:38.067843 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bc9b9781-0d8a-4e6e-aec9-6df154f21f70 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:38.068480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bc9b9781-0d8a-4e6e-aec9-6df154f21f70 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:38.074936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bc9b9781-0d8a-4e6e-aec9-6df154f21f70 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:38.075828 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bc9b9781-0d8a-4e6e-aec9-6df154f21f70 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:38.076750 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bc9b9781-0d8a-4e6e-aec9-6df154f21f70 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:38.077649 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bc9b9781-0d8a-4e6e-aec9-6df154f21f70 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:38.077764 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-47f56972-cd3a-4f37-b9af-f5ed3f4e048c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:38.078341 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-47f56972-cd3a-4f37-b9af-f5ed3f4e048c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:38.086136 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-47f56972-cd3a-4f37-b9af-f5ed3f4e048c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:38.086591 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-47f56972-cd3a-4f37-b9af-f5ed3f4e048c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:38.087482 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-47f56972-cd3a-4f37-b9af-f5ed3f4e048c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:38.088111 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-47f56972-cd3a-4f37-b9af-f5ed3f4e048c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:38.542239 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-47f56972-cd3a-4f37-b9af-f5ed3f4e048c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:38.543402 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bc9b9781-0d8a-4e6e-aec9-6df154f21f70 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:38.558548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-47f56972-cd3a-4f37-b9af-f5ed3f4e048c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:38.561638 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bc9b9781-0d8a-4e6e-aec9-6df154f21f70 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1502 microversion: 2.1 time: 0.501201 Jun 24 08:42:38.562235 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 98/184] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:38 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1502 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:38.564649 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-47f56972-cd3a-4f37-b9af-f5ed3f4e048c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:38.565939 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-47f56972-cd3a-4f37-b9af-f5ed3f4e048c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.492085 Jun 24 08:42:38.566490 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 87/185] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:38 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:38.572254 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6385aef3-2a9e-44bc-be04-e695adbfad27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:38.572868 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6385aef3-2a9e-44bc-be04-e695adbfad27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:38.580682 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6385aef3-2a9e-44bc-be04-e695adbfad27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:38.581388 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6385aef3-2a9e-44bc-be04-e695adbfad27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:38.582567 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6385aef3-2a9e-44bc-be04-e695adbfad27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:38.583013 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6385aef3-2a9e-44bc-be04-e695adbfad27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:38.585456 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2d5ee3ac-1069-48e9-92a5-6c42f023a0a5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:38.588221 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2d5ee3ac-1069-48e9-92a5-6c42f023a0a5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:38.599547 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d5ee3ac-1069-48e9-92a5-6c42f023a0a5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:38.602070 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d5ee3ac-1069-48e9-92a5-6c42f023a0a5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:38.603487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d5ee3ac-1069-48e9-92a5-6c42f023a0a5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:38.613602 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2d5ee3ac-1069-48e9-92a5-6c42f023a0a5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:38.704740 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:38.857764 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6385aef3-2a9e-44bc-be04-e695adbfad27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:38.869493 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6385aef3-2a9e-44bc-be04-e695adbfad27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1513 microversion: 2.1 time: 0.300537 Jun 24 08:42:38.869493 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 88/186] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:38 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1513 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:38.903306 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2c4c4c35-7acf-4971-8f1f-b4c873259e8f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:38.904732 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2c4c4c35-7acf-4971-8f1f-b4c873259e8f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:38.920907 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c4c4c35-7acf-4971-8f1f-b4c873259e8f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:38.922336 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c4c4c35-7acf-4971-8f1f-b4c873259e8f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:38.925065 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c4c4c35-7acf-4971-8f1f-b4c873259e8f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:38.927115 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c4c4c35-7acf-4971-8f1f-b4c873259e8f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:38.938327 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2d5ee3ac-1069-48e9-92a5-6c42f023a0a5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:38.952112 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2d5ee3ac-1069-48e9-92a5-6c42f023a0a5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.388815 Jun 24 08:42:38.953677 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 99/187] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:38 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:39.032258 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-2c4c4c35-7acf-4971-8f1f-b4c873259e8f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lazy-loading 'flavor' on Instance uuid b1b5105a-20c5-4e33-b0d8-74b5033b5c38 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:42:39.221059 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2c4c4c35-7acf-4971-8f1f-b4c873259e8f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "POST /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38/action" status: 200 len: 32 microversion: 2.1 time: 0.337663 Jun 24 08:42:39.222092 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 89/188] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Jun 24 08:42:38 2022] POST /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38/action => generated 32 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:42:39.231826 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-62df6553-9bf8-462c-9883-b8065360eb01 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:39.232401 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-62df6553-9bf8-462c-9883-b8065360eb01 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:39.248448 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62df6553-9bf8-462c-9883-b8065360eb01 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:39.248924 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62df6553-9bf8-462c-9883-b8065360eb01 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:39.249716 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62df6553-9bf8-462c-9883-b8065360eb01 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:39.251999 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62df6553-9bf8-462c-9883-b8065360eb01 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:39.445743 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-62df6553-9bf8-462c-9883-b8065360eb01 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:39.457018 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-62df6553-9bf8-462c-9883-b8065360eb01 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.229802 Jun 24 08:42:39.459485 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 100/189] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:39 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:39.593842 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3f33e324-7098-4ddd-ab63-c868c92a5cdd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:39.593842 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3f33e324-7098-4ddd-ab63-c868c92a5cdd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:39.593842 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f33e324-7098-4ddd-ab63-c868c92a5cdd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:39.593842 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f33e324-7098-4ddd-ab63-c868c92a5cdd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:39.594181 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f33e324-7098-4ddd-ab63-c868c92a5cdd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:39.594788 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f33e324-7098-4ddd-ab63-c868c92a5cdd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:39.601231 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:39.790287 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3f33e324-7098-4ddd-ab63-c868c92a5cdd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:39.800639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3f33e324-7098-4ddd-ab63-c868c92a5cdd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:39.803768 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3f33e324-7098-4ddd-ab63-c868c92a5cdd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:39.804956 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3f33e324-7098-4ddd-ab63-c868c92a5cdd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1406 microversion: 2.20 time: 0.223915 Jun 24 08:42:39.815146 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 90/190] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:39 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:39.972892 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-44a99909-9001-490b-92e5-fa0c7f76ce93 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:39.976576 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-44a99909-9001-490b-92e5-fa0c7f76ce93 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:39.990825 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-44a99909-9001-490b-92e5-fa0c7f76ce93 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:39.999633 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-44a99909-9001-490b-92e5-fa0c7f76ce93 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:40.008632 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-44a99909-9001-490b-92e5-fa0c7f76ce93 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:40.009185 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-44a99909-9001-490b-92e5-fa0c7f76ce93 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:40.130272 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f801cd2a-aaa9-448b-bc87-1cb51929d08d tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa3dfbe4-51a3-4bfb-bea0-9d233dc11f80"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:40.131695 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f801cd2a-aaa9-448b-bc87-1cb51929d08d tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:40.134627 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:40.142039 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f801cd2a-aaa9-448b-bc87-1cb51929d08d tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:40.142791 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f801cd2a-aaa9-448b-bc87-1cb51929d08d tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:40.143800 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f801cd2a-aaa9-448b-bc87-1cb51929d08d tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:40.144474 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f801cd2a-aaa9-448b-bc87-1cb51929d08d tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:40.162421 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-44a99909-9001-490b-92e5-fa0c7f76ce93 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:40.170771 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-44a99909-9001-490b-92e5-fa0c7f76ce93 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.201710 Jun 24 08:42:40.171691 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 101/191] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:39 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:40.476147 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8f7e2986-c81b-4445-a3da-1349a83fdbce tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:40.476919 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8f7e2986-c81b-4445-a3da-1349a83fdbce tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:40.483497 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8f7e2986-c81b-4445-a3da-1349a83fdbce tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:40.483954 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8f7e2986-c81b-4445-a3da-1349a83fdbce tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:40.484835 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8f7e2986-c81b-4445-a3da-1349a83fdbce tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:40.485268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8f7e2986-c81b-4445-a3da-1349a83fdbce tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:40.651398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8f7e2986-c81b-4445-a3da-1349a83fdbce tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:40.659444 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8f7e2986-c81b-4445-a3da-1349a83fdbce tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.188004 Jun 24 08:42:40.661783 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 102/192] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:40 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:40.823787 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2ff011a0-2ed8-491d-ab93-dc01254b508c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:40.824684 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2ff011a0-2ed8-491d-ab93-dc01254b508c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:40.831533 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2ff011a0-2ed8-491d-ab93-dc01254b508c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:40.831722 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2ff011a0-2ed8-491d-ab93-dc01254b508c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:40.833232 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2ff011a0-2ed8-491d-ab93-dc01254b508c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:40.834519 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2ff011a0-2ed8-491d-ab93-dc01254b508c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:41.085526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2ff011a0-2ed8-491d-ab93-dc01254b508c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:41.095078 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2ff011a0-2ed8-491d-ab93-dc01254b508c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:41.097245 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2ff011a0-2ed8-491d-ab93-dc01254b508c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:41.099400 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2ff011a0-2ed8-491d-ab93-dc01254b508c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1598 microversion: 2.20 time: 0.280744 Jun 24 08:42:41.100118 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 103/193] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:42:40 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1598 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:42:41.120430 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3f03099d-6e77-4342-8761-7eb1ac19ff6b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:41.120931 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3f03099d-6e77-4342-8761-7eb1ac19ff6b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:41.127181 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3f03099d-6e77-4342-8761-7eb1ac19ff6b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:41.127758 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3f03099d-6e77-4342-8761-7eb1ac19ff6b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:41.128692 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3f03099d-6e77-4342-8761-7eb1ac19ff6b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:41.129178 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3f03099d-6e77-4342-8761-7eb1ac19ff6b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:41.254999 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3f03099d-6e77-4342-8761-7eb1ac19ff6b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.138060 Jun 24 08:42:41.255732 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 104/194] 10.222.0.43 () {60 vars in 1315 bytes} [Fri Jun 24 08:42:41 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:42:41.262217 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-349cdff1-5d40-4c2c-8df6-880c3610e2f2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:41.263467 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-349cdff1-5d40-4c2c-8df6-880c3610e2f2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:41.273244 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-349cdff1-5d40-4c2c-8df6-880c3610e2f2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:41.274547 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-349cdff1-5d40-4c2c-8df6-880c3610e2f2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:41.275551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-349cdff1-5d40-4c2c-8df6-880c3610e2f2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:41.276268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-349cdff1-5d40-4c2c-8df6-880c3610e2f2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:41.595425 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f801cd2a-aaa9-448b-bc87-1cb51929d08d tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "POST /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.468934 Jun 24 08:42:41.596280 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 91/195] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Jun 24 08:42:40 2022] POST /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53/os-volume_attachments => generated 194 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:42:41.654307 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-349cdff1-5d40-4c2c-8df6-880c3610e2f2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:41.677295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-349cdff1-5d40-4c2c-8df6-880c3610e2f2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.418593 Jun 24 08:42:41.679886 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 105/196] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:41 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:41.681341 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7faf9cb6-3c2e-4777-8df4-27728c075031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:41.682643 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7faf9cb6-3c2e-4777-8df4-27728c075031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:41.702311 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7faf9cb6-3c2e-4777-8df4-27728c075031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:41.704038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7faf9cb6-3c2e-4777-8df4-27728c075031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:41.706141 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7faf9cb6-3c2e-4777-8df4-27728c075031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:41.708780 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7faf9cb6-3c2e-4777-8df4-27728c075031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:42.215061 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7faf9cb6-3c2e-4777-8df4-27728c075031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:42.224447 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7faf9cb6-3c2e-4777-8df4-27728c075031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.549961 Jun 24 08:42:42.225346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 92/197] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:41 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:42.696322 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-81395bfb-40cc-459b-98c0-5b9a90c60427 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:42.696922 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-81395bfb-40cc-459b-98c0-5b9a90c60427 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:42.702927 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81395bfb-40cc-459b-98c0-5b9a90c60427 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:42.703671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81395bfb-40cc-459b-98c0-5b9a90c60427 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:42.704438 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81395bfb-40cc-459b-98c0-5b9a90c60427 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:42.704868 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81395bfb-40cc-459b-98c0-5b9a90c60427 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:42.964732 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-81395bfb-40cc-459b-98c0-5b9a90c60427 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:42.972833 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-81395bfb-40cc-459b-98c0-5b9a90c60427 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.280856 Jun 24 08:42:42.983393 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 106/198] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:42 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:43.244574 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-02831b82-8ea4-40e4-839d-3b218640b075 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:43.245697 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-02831b82-8ea4-40e4-839d-3b218640b075 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:43.253504 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02831b82-8ea4-40e4-839d-3b218640b075 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:43.257133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02831b82-8ea4-40e4-839d-3b218640b075 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:43.258123 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02831b82-8ea4-40e4-839d-3b218640b075 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:43.263473 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02831b82-8ea4-40e4-839d-3b218640b075 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:43.298286 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-0116d8f0-6b10-4d94-bed2-18c51e719955 req-e9d923a4-10e9-44dd-91e6-9939e014926c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f6b0e38-4e81-4595-9acd-ec8335bb5db5", "tag": "6c3b5569-2019-4bad-bd54-dc7ff5e8c6b1"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:43.317468 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0116d8f0-6b10-4d94-bed2-18c51e719955 req-e9d923a4-10e9-44dd-91e6-9939e014926c service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:43.318201 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0116d8f0-6b10-4d94-bed2-18c51e719955 req-e9d923a4-10e9-44dd-91e6-9939e014926c service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:43.347898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-0116d8f0-6b10-4d94-bed2-18c51e719955 req-e9d923a4-10e9-44dd-91e6-9939e014926c service nova] Creating event network-changed:6c3b5569-2019-4bad-bd54-dc7ff5e8c6b1 for instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 on hv-cinder-84517 Jun 24 08:42:43.355810 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-0116d8f0-6b10-4d94-bed2-18c51e719955 req-e9d923a4-10e9-44dd-91e6-9939e014926c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060616 Jun 24 08:42:43.357102 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 107/199] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:43.512824 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-02831b82-8ea4-40e4-839d-3b218640b075 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:43.525502 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-02831b82-8ea4-40e4-839d-3b218640b075 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.286371 Jun 24 08:42:43.532038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 93/200] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:43 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:43.990249 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ee27eeaf-58da-4db5-9f13-c6c6be72c7f5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:43.991158 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ee27eeaf-58da-4db5-9f13-c6c6be72c7f5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:43.998257 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ee27eeaf-58da-4db5-9f13-c6c6be72c7f5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:43.998710 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ee27eeaf-58da-4db5-9f13-c6c6be72c7f5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:43.999731 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ee27eeaf-58da-4db5-9f13-c6c6be72c7f5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:44.000171 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ee27eeaf-58da-4db5-9f13-c6c6be72c7f5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:44.147607 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ee27eeaf-58da-4db5-9f13-c6c6be72c7f5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:44.156154 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ee27eeaf-58da-4db5-9f13-c6c6be72c7f5 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.169922 Jun 24 08:42:44.157775 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 108/201] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:43 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:44.543881 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1f12a29a-faf9-4de8-8edc-fb2001774021 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:44.544578 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1f12a29a-faf9-4de8-8edc-fb2001774021 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:44.552509 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f12a29a-faf9-4de8-8edc-fb2001774021 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:44.553256 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f12a29a-faf9-4de8-8edc-fb2001774021 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:44.554101 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f12a29a-faf9-4de8-8edc-fb2001774021 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:44.554607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f12a29a-faf9-4de8-8edc-fb2001774021 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:44.728162 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1f12a29a-faf9-4de8-8edc-fb2001774021 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:44.737191 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1f12a29a-faf9-4de8-8edc-fb2001774021 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.197445 Jun 24 08:42:44.747436 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 94/202] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:44 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:45.173062 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c14cb4d9-e2a3-4fb6-b02d-b4bce69cb888 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:45.173661 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c14cb4d9-e2a3-4fb6-b02d-b4bce69cb888 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:45.179665 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c14cb4d9-e2a3-4fb6-b02d-b4bce69cb888 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:45.180111 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c14cb4d9-e2a3-4fb6-b02d-b4bce69cb888 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:45.180867 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c14cb4d9-e2a3-4fb6-b02d-b4bce69cb888 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:45.181292 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c14cb4d9-e2a3-4fb6-b02d-b4bce69cb888 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:45.307933 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c14cb4d9-e2a3-4fb6-b02d-b4bce69cb888 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:45.315172 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c14cb4d9-e2a3-4fb6-b02d-b4bce69cb888 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.145984 Jun 24 08:42:45.315755 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 109/203] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:45 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:45.755393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e158c5b7-f374-4968-a6cb-394213a95c8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:45.755942 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e158c5b7-f374-4968-a6cb-394213a95c8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:45.762614 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e158c5b7-f374-4968-a6cb-394213a95c8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:45.763063 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e158c5b7-f374-4968-a6cb-394213a95c8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:45.763852 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e158c5b7-f374-4968-a6cb-394213a95c8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:45.764288 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e158c5b7-f374-4968-a6cb-394213a95c8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:45.891321 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e158c5b7-f374-4968-a6cb-394213a95c8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:45.898752 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e158c5b7-f374-4968-a6cb-394213a95c8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.147769 Jun 24 08:42:45.899349 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 95/204] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:45 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:46.331958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e43f9ff3-d9b8-4400-990c-f93ca2730159 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:46.332563 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e43f9ff3-d9b8-4400-990c-f93ca2730159 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:46.338775 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e43f9ff3-d9b8-4400-990c-f93ca2730159 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:46.339236 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e43f9ff3-d9b8-4400-990c-f93ca2730159 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:46.340008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e43f9ff3-d9b8-4400-990c-f93ca2730159 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:46.340447 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e43f9ff3-d9b8-4400-990c-f93ca2730159 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:46.468088 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e43f9ff3-d9b8-4400-990c-f93ca2730159 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:46.475953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e43f9ff3-d9b8-4400-990c-f93ca2730159 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.147822 Jun 24 08:42:46.476510 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 110/205] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:46 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:46.914403 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-95567ab6-ab74-4949-9eb1-5419a8ebe465 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:46.915015 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-95567ab6-ab74-4949-9eb1-5419a8ebe465 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:46.921729 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-95567ab6-ab74-4949-9eb1-5419a8ebe465 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:46.922175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-95567ab6-ab74-4949-9eb1-5419a8ebe465 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:46.922929 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-95567ab6-ab74-4949-9eb1-5419a8ebe465 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:46.923398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-95567ab6-ab74-4949-9eb1-5419a8ebe465 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:47.057736 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-95567ab6-ab74-4949-9eb1-5419a8ebe465 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:47.065163 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-95567ab6-ab74-4949-9eb1-5419a8ebe465 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.154553 Jun 24 08:42:47.065746 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 96/206] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:46 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:47.492627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f954de50-98f1-401b-9843-a683ba378fdb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:47.493232 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f954de50-98f1-401b-9843-a683ba378fdb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:47.499322 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f954de50-98f1-401b-9843-a683ba378fdb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:47.499767 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f954de50-98f1-401b-9843-a683ba378fdb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:47.500514 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f954de50-98f1-401b-9843-a683ba378fdb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:47.500940 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f954de50-98f1-401b-9843-a683ba378fdb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:47.626914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f954de50-98f1-401b-9843-a683ba378fdb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:47.634669 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f954de50-98f1-401b-9843-a683ba378fdb tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.146289 Jun 24 08:42:47.635274 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 111/207] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:47 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:48.081884 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3b361875-a2a2-44a8-b636-5210cc105c43 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:48.082567 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3b361875-a2a2-44a8-b636-5210cc105c43 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:48.090666 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b361875-a2a2-44a8-b636-5210cc105c43 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:48.091121 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b361875-a2a2-44a8-b636-5210cc105c43 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:48.091924 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b361875-a2a2-44a8-b636-5210cc105c43 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:48.099943 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b361875-a2a2-44a8-b636-5210cc105c43 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:48.299238 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3b361875-a2a2-44a8-b636-5210cc105c43 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:48.307312 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3b361875-a2a2-44a8-b636-5210cc105c43 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.229095 Jun 24 08:42:48.307894 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 97/208] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:48 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:48.651904 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1d671ebd-cfe3-479e-b17c-18a022b9b694 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:48.652523 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1d671ebd-cfe3-479e-b17c-18a022b9b694 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:48.658526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d671ebd-cfe3-479e-b17c-18a022b9b694 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:48.658976 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d671ebd-cfe3-479e-b17c-18a022b9b694 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:48.659789 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d671ebd-cfe3-479e-b17c-18a022b9b694 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:48.660228 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1d671ebd-cfe3-479e-b17c-18a022b9b694 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:48.791756 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1d671ebd-cfe3-479e-b17c-18a022b9b694 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:48.799750 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1d671ebd-cfe3-479e-b17c-18a022b9b694 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.151662 Jun 24 08:42:48.800387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 112/209] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:48 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:49.323947 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2ae20e1d-a740-48df-8ce1-aa9e63536e9e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:49.324552 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2ae20e1d-a740-48df-8ce1-aa9e63536e9e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:49.331056 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ae20e1d-a740-48df-8ce1-aa9e63536e9e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:49.331534 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ae20e1d-a740-48df-8ce1-aa9e63536e9e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:49.332286 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ae20e1d-a740-48df-8ce1-aa9e63536e9e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:49.333338 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ae20e1d-a740-48df-8ce1-aa9e63536e9e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:49.461501 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2ae20e1d-a740-48df-8ce1-aa9e63536e9e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:49.469112 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2ae20e1d-a740-48df-8ce1-aa9e63536e9e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.148893 Jun 24 08:42:49.469748 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 98/210] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:49 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:49.817552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f66eecfd-104a-4dcf-bcac-571271dc0cf8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:49.818898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f66eecfd-104a-4dcf-bcac-571271dc0cf8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:49.825456 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f66eecfd-104a-4dcf-bcac-571271dc0cf8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:49.826141 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f66eecfd-104a-4dcf-bcac-571271dc0cf8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:49.827367 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f66eecfd-104a-4dcf-bcac-571271dc0cf8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:49.827825 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f66eecfd-104a-4dcf-bcac-571271dc0cf8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:49.891192 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-a8536299-1c84-41e6-862c-946e7ce47f85 req-8741a12e-d2d7-4c13-bdd1-b8bc96a02d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95bd72b-348c-451a-91f9-a6c57e78f0ab", "name": "network-vif-plugged", "status": "completed", "tag": "afc37d28-9803-437f-a7be-97c7b873c3e9"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:49.905804 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-a8536299-1c84-41e6-862c-946e7ce47f85 req-8741a12e-d2d7-4c13-bdd1-b8bc96a02d55 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:49.906369 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-a8536299-1c84-41e6-862c-946e7ce47f85 req-8741a12e-d2d7-4c13-bdd1-b8bc96a02d55 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:49.924598 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-a8536299-1c84-41e6-862c-946e7ce47f85 req-8741a12e-d2d7-4c13-bdd1-b8bc96a02d55 service nova] Creating event network-vif-plugged:afc37d28-9803-437f-a7be-97c7b873c3e9 for instance e95bd72b-348c-451a-91f9-a6c57e78f0ab on hv-cinder-84517 Jun 24 08:42:49.935969 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-a8536299-1c84-41e6-862c-946e7ce47f85 req-8741a12e-d2d7-4c13-bdd1-b8bc96a02d55 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045143 Jun 24 08:42:49.937441 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 99/211] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:42:49.994428 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f66eecfd-104a-4dcf-bcac-571271dc0cf8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:50.002564 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f66eecfd-104a-4dcf-bcac-571271dc0cf8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.189747 Jun 24 08:42:50.003138 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 113/212] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:49 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:50.492036 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fb86e692-8282-4d02-83f0-552f29f88f83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:50.493241 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fb86e692-8282-4d02-83f0-552f29f88f83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:50.507806 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb86e692-8282-4d02-83f0-552f29f88f83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:50.508253 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb86e692-8282-4d02-83f0-552f29f88f83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:50.509992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb86e692-8282-4d02-83f0-552f29f88f83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:50.510447 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb86e692-8282-4d02-83f0-552f29f88f83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:50.719109 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fb86e692-8282-4d02-83f0-552f29f88f83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:50.729475 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fb86e692-8282-4d02-83f0-552f29f88f83 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.244997 Jun 24 08:42:50.730980 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 100/213] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:50 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:51.023475 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d9719e75-5f02-4bc3-9a76-332825a3f8e8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:51.025236 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d9719e75-5f02-4bc3-9a76-332825a3f8e8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:51.035974 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9719e75-5f02-4bc3-9a76-332825a3f8e8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:51.037103 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9719e75-5f02-4bc3-9a76-332825a3f8e8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:51.038202 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9719e75-5f02-4bc3-9a76-332825a3f8e8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:51.038952 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9719e75-5f02-4bc3-9a76-332825a3f8e8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:51.235772 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d9719e75-5f02-4bc3-9a76-332825a3f8e8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:51.243866 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d9719e75-5f02-4bc3-9a76-332825a3f8e8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1313 microversion: 2.1 time: 0.227769 Jun 24 08:42:51.244659 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 114/214] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:51 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:51.747462 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-83b4a54a-6822-4d4a-9cad-cb74f74a5927 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:51.749384 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-83b4a54a-6822-4d4a-9cad-cb74f74a5927 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:51.757211 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-83b4a54a-6822-4d4a-9cad-cb74f74a5927 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:51.757901 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-83b4a54a-6822-4d4a-9cad-cb74f74a5927 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:51.758885 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-83b4a54a-6822-4d4a-9cad-cb74f74a5927 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:51.759560 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-83b4a54a-6822-4d4a-9cad-cb74f74a5927 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:51.913658 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-83b4a54a-6822-4d4a-9cad-cb74f74a5927 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:51.921746 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-83b4a54a-6822-4d4a-9cad-cb74f74a5927 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.178334 Jun 24 08:42:51.922318 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 101/215] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:51 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:52.261296 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-35e71f6e-6701-4c66-a78e-f245da73e377 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:52.261938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-35e71f6e-6701-4c66-a78e-f245da73e377 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:52.272321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-35e71f6e-6701-4c66-a78e-f245da73e377 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:52.273034 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-35e71f6e-6701-4c66-a78e-f245da73e377 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:52.273913 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-35e71f6e-6701-4c66-a78e-f245da73e377 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:52.274450 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-35e71f6e-6701-4c66-a78e-f245da73e377 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:52.422240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-35e71f6e-6701-4c66-a78e-f245da73e377 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:52.430149 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-35e71f6e-6701-4c66-a78e-f245da73e377 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1498 microversion: 2.1 time: 0.172732 Jun 24 08:42:52.430716 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 115/216] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:52 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1498 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:52.937795 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c64d865e-b31c-4b8b-9c91-cfee71899592 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:52.939037 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c64d865e-b31c-4b8b-9c91-cfee71899592 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:52.948680 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c64d865e-b31c-4b8b-9c91-cfee71899592 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:52.949386 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c64d865e-b31c-4b8b-9c91-cfee71899592 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:52.950645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c64d865e-b31c-4b8b-9c91-cfee71899592 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:52.950939 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c64d865e-b31c-4b8b-9c91-cfee71899592 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:53.140058 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c3c07d67-8241-4c46-8ccc-f2167e5872ec tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:53.140615 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c3c07d67-8241-4c46-8ccc-f2167e5872ec tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:53.151857 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c3c07d67-8241-4c46-8ccc-f2167e5872ec tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:53.152388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c3c07d67-8241-4c46-8ccc-f2167e5872ec tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:53.153218 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c3c07d67-8241-4c46-8ccc-f2167e5872ec tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:53.153933 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c3c07d67-8241-4c46-8ccc-f2167e5872ec tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:53.217138 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c3c07d67-8241-4c46-8ccc-f2167e5872ec tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:42:53.242654 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:53.246761 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c64d865e-b31c-4b8b-9c91-cfee71899592 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:53.261222 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c64d865e-b31c-4b8b-9c91-cfee71899592 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.324855 Jun 24 08:42:53.262348 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 102/217] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:52 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:53.336033 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c3c07d67-8241-4c46-8ccc-f2167e5872ec tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 204 len: 0 microversion: 2.1 time: 0.199702 Jun 24 08:42:53.337287 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 116/218] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:42:53 2022] DELETE /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:42:53.352265 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7c83d854-eebb-411e-8e8f-07e822cd440c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:53.353382 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7c83d854-eebb-411e-8e8f-07e822cd440c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:53.364553 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c83d854-eebb-411e-8e8f-07e822cd440c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:53.365168 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c83d854-eebb-411e-8e8f-07e822cd440c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:53.366684 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c83d854-eebb-411e-8e8f-07e822cd440c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:53.367314 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c83d854-eebb-411e-8e8f-07e822cd440c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:53.574199 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7c83d854-eebb-411e-8e8f-07e822cd440c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:53.595405 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7c83d854-eebb-411e-8e8f-07e822cd440c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1504 microversion: 2.1 time: 0.253346 Jun 24 08:42:53.595989 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 103/219] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:53 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:54.279730 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4eacb241-1bf9-4147-a2e8-be2995a63554 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:54.280447 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4eacb241-1bf9-4147-a2e8-be2995a63554 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:54.293747 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4eacb241-1bf9-4147-a2e8-be2995a63554 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:54.294426 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4eacb241-1bf9-4147-a2e8-be2995a63554 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:54.295378 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4eacb241-1bf9-4147-a2e8-be2995a63554 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:54.295870 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4eacb241-1bf9-4147-a2e8-be2995a63554 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:54.453079 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4eacb241-1bf9-4147-a2e8-be2995a63554 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:54.481829 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4eacb241-1bf9-4147-a2e8-be2995a63554 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.205925 Jun 24 08:42:54.483002 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 117/220] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:54 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:54.625805 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7552a152-42c2-4063-93fb-5a86be6eed64 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:54.626523 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7552a152-42c2-4063-93fb-5a86be6eed64 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:54.633422 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7552a152-42c2-4063-93fb-5a86be6eed64 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:54.633975 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7552a152-42c2-4063-93fb-5a86be6eed64 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:54.634817 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7552a152-42c2-4063-93fb-5a86be6eed64 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:54.635457 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7552a152-42c2-4063-93fb-5a86be6eed64 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:54.771983 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7552a152-42c2-4063-93fb-5a86be6eed64 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:54.779413 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7552a152-42c2-4063-93fb-5a86be6eed64 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1504 microversion: 2.1 time: 0.157847 Jun 24 08:42:54.779975 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 104/221] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:54 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:55.498619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a88cec10-9eb6-40cc-8e98-53cfe08c43f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:55.499247 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a88cec10-9eb6-40cc-8e98-53cfe08c43f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:55.506187 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a88cec10-9eb6-40cc-8e98-53cfe08c43f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:55.506870 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a88cec10-9eb6-40cc-8e98-53cfe08c43f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:55.507409 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a88cec10-9eb6-40cc-8e98-53cfe08c43f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:55.508219 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a88cec10-9eb6-40cc-8e98-53cfe08c43f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:55.656455 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a88cec10-9eb6-40cc-8e98-53cfe08c43f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:55.671461 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a88cec10-9eb6-40cc-8e98-53cfe08c43f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.176458 Jun 24 08:42:55.672227 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 118/222] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:55 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:55.796924 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ad10c030-c5b6-44fa-b9cf-aa2e9e8f0a12 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:55.798145 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ad10c030-c5b6-44fa-b9cf-aa2e9e8f0a12 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:55.805151 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad10c030-c5b6-44fa-b9cf-aa2e9e8f0a12 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:55.805608 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad10c030-c5b6-44fa-b9cf-aa2e9e8f0a12 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:55.806396 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad10c030-c5b6-44fa-b9cf-aa2e9e8f0a12 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:55.806825 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad10c030-c5b6-44fa-b9cf-aa2e9e8f0a12 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:55.988339 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ad10c030-c5b6-44fa-b9cf-aa2e9e8f0a12 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:55.998623 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ad10c030-c5b6-44fa-b9cf-aa2e9e8f0a12 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1504 microversion: 2.1 time: 0.205511 Jun 24 08:42:56.001470 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 105/223] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:55 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:56.317079 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-31acb60b-43c1-4555-8257-ba0fade273db req-d473840a-71f3-4293-ba09-2a4a2ac7fa85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95bd72b-348c-451a-91f9-a6c57e78f0ab", "name": "network-vif-deleted", "tag": "afc37d28-9803-437f-a7be-97c7b873c3e9"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:56.327196 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-31acb60b-43c1-4555-8257-ba0fade273db req-d473840a-71f3-4293-ba09-2a4a2ac7fa85 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:56.327758 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-31acb60b-43c1-4555-8257-ba0fade273db req-d473840a-71f3-4293-ba09-2a4a2ac7fa85 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:56.341864 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-31acb60b-43c1-4555-8257-ba0fade273db req-d473840a-71f3-4293-ba09-2a4a2ac7fa85 service nova] Creating event network-vif-deleted:afc37d28-9803-437f-a7be-97c7b873c3e9 for instance e95bd72b-348c-451a-91f9-a6c57e78f0ab on hv-cinder-84517 Jun 24 08:42:56.348883 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-31acb60b-43c1-4555-8257-ba0fade273db req-d473840a-71f3-4293-ba09-2a4a2ac7fa85 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035766 Jun 24 08:42:56.351390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 119/224] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:42:56.688282 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-08242223-e40c-4552-acac-6b5ec75a34e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:56.689135 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-08242223-e40c-4552-acac-6b5ec75a34e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:56.696300 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-08242223-e40c-4552-acac-6b5ec75a34e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:56.696900 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-08242223-e40c-4552-acac-6b5ec75a34e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:56.697734 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-08242223-e40c-4552-acac-6b5ec75a34e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:56.698187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-08242223-e40c-4552-acac-6b5ec75a34e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:56.703161 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:56.849815 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-08242223-e40c-4552-acac-6b5ec75a34e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:56.858507 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-08242223-e40c-4552-acac-6b5ec75a34e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.174124 Jun 24 08:42:56.859195 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 106/225] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:56 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:57.017569 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-116f17d8-d07f-4d6c-8723-807a84cbbdea tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:57.018777 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-116f17d8-d07f-4d6c-8723-807a84cbbdea tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:57.026508 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-116f17d8-d07f-4d6c-8723-807a84cbbdea tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:57.027067 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-116f17d8-d07f-4d6c-8723-807a84cbbdea tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:57.028153 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-116f17d8-d07f-4d6c-8723-807a84cbbdea tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:57.028589 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-116f17d8-d07f-4d6c-8723-807a84cbbdea tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:57.064384 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-116f17d8-d07f-4d6c-8723-807a84cbbdea tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:57.064901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-116f17d8-d07f-4d6c-8723-807a84cbbdea tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:57.065807 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-116f17d8-d07f-4d6c-8723-807a84cbbdea tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lazy-loading 'fault' on Instance uuid e95bd72b-348c-451a-91f9-a6c57e78f0ab {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:42:57.126606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-116f17d8-d07f-4d6c-8723-807a84cbbdea tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:57.134182 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-116f17d8-d07f-4d6c-8723-807a84cbbdea tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1303 microversion: 2.1 time: 0.121576 Jun 24 08:42:57.134736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 120/226] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:57 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:57.885414 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-de9f5b20-b77a-4f47-a067-010825a512ca tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:57.888471 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-de9f5b20-b77a-4f47-a067-010825a512ca tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:57.899116 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de9f5b20-b77a-4f47-a067-010825a512ca tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:57.899907 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de9f5b20-b77a-4f47-a067-010825a512ca tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:57.900870 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de9f5b20-b77a-4f47-a067-010825a512ca tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:57.901627 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-de9f5b20-b77a-4f47-a067-010825a512ca tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:58.064753 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-de9f5b20-b77a-4f47-a067-010825a512ca tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:58.074675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-de9f5b20-b77a-4f47-a067-010825a512ca tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.202698 Jun 24 08:42:58.085697 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 107/227] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:57 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:42:58.151757 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d8cc4062-748b-4e67-8bde-d6d25a564917 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:58.152390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d8cc4062-748b-4e67-8bde-d6d25a564917 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:58.158725 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d8cc4062-748b-4e67-8bde-d6d25a564917 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:58.159445 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d8cc4062-748b-4e67-8bde-d6d25a564917 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:58.160442 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d8cc4062-748b-4e67-8bde-d6d25a564917 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:58.161408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d8cc4062-748b-4e67-8bde-d6d25a564917 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:58.211458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d8cc4062-748b-4e67-8bde-d6d25a564917 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:58.211882 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d8cc4062-748b-4e67-8bde-d6d25a564917 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:58.212399 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-d8cc4062-748b-4e67-8bde-d6d25a564917 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lazy-loading 'fault' on Instance uuid e95bd72b-348c-451a-91f9-a6c57e78f0ab {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:42:58.269973 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d8cc4062-748b-4e67-8bde-d6d25a564917 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:58.280678 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d8cc4062-748b-4e67-8bde-d6d25a564917 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 200 len: 1303 microversion: 2.1 time: 0.132975 Jun 24 08:42:58.281555 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 121/228] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:58 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 1303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:59.093841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7724b718-285b-418b-beb9-a45b9a7da4bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:59.094458 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7724b718-285b-418b-beb9-a45b9a7da4bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:59.104071 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7724b718-285b-418b-beb9-a45b9a7da4bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:59.104584 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7724b718-285b-418b-beb9-a45b9a7da4bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:59.105435 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7724b718-285b-418b-beb9-a45b9a7da4bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:59.106063 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7724b718-285b-418b-beb9-a45b9a7da4bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:59.299535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1eef2787-f51a-4e0d-a0b5-09a0bbbd5a68 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:42:59.300245 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1eef2787-f51a-4e0d-a0b5-09a0bbbd5a68 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: e95bd72b-348c-451a-91f9-a6c57e78f0ab] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:42:59.309598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1eef2787-f51a-4e0d-a0b5-09a0bbbd5a68 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:59.310599 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1eef2787-f51a-4e0d-a0b5-09a0bbbd5a68 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:59.318308 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1eef2787-f51a-4e0d-a0b5-09a0bbbd5a68 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:59.318755 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1eef2787-f51a-4e0d-a0b5-09a0bbbd5a68 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:59.334699 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-1eef2787-f51a-4e0d-a0b5-09a0bbbd5a68 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] HTTP exception thrown: Instance e95bd72b-348c-451a-91f9-a6c57e78f0ab could not be found. Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1eef2787-f51a-4e0d-a0b5-09a0bbbd5a68 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Request method failure captured: Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab HTTP/1.1 Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXjnjG37TMVBnZW7tEgM1_K_fuwOv_AR2Jb9rlT36vWXXAv0lBF0FfYvEykCDQLnM_3sjLHYR6805tfrVn1o1J53RKRO0ReeHuA59m_9aLe1rcVuZNBcZwmv4jYNgJvdXLIjRI7PWpB9XGvcrJbrrQuTJ1ZMDAvp1VkMo4x7XQjIasM Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 5e6d51dece9847669e9a666633ce634d Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesActionsTest-1978318296 Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:42:59.339656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:42:59.340903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e6d51dece9847669e9a666633ce634d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5e6d51dece9847669e9a666633ce634d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5e6d51dece9847669e9a666633ce634d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e6d51dece9847669e9a666633ce634d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:42:59.340903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesActionsTest-1978318296 Jun 24 08:42:59.340903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 5e6d51dece9847669e9a666633ce634d Jun 24 08:42:59.340903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesActionsTest-1978318296 Jun 24 08:42:59.340903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesActionsTest-1978318296-project Jun 24 08:42:59.340903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:42:59.340903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:42:59.340903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 46097d36b6fc4df5b510d279a4648eb7 Jun 24 08:42:59.340903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesActionsTest-1978318296-project Jun 24 08:42:59.340903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:42:59.340903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance e95bd72b-348c-451a-91f9-a6c57e78f0ab could not be found. Jun 24 08:42:59.340903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': 'e95bd72b-348c-451a-91f9-a6c57e78f0ab'} Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e95bd72b-348c-451a-91f9-a6c57e78f0ab could not be found. Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:42:59.341622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e95bd72b-348c-451a-91f9-a6c57e78f0ab could not be found. Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e95bd72b-348c-451a-91f9-a6c57e78f0ab could not be found. Jun 24 08:42:59.342780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:42:59.351146 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1eef2787-f51a-4e0d-a0b5-09a0bbbd5a68 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Returning 404 to user: Instance e95bd72b-348c-451a-91f9-a6c57e78f0ab could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:42:59.351146 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1eef2787-f51a-4e0d-a0b5-09a0bbbd5a68 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab" status: 404 len: 111 microversion: 2.1 time: 0.046621 Jun 24 08:42:59.351146 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 122/229] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:59 2022] GET /compute/v2.1/servers/e95bd72b-348c-451a-91f9-a6c57e78f0ab => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:42:59.404312 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7724b718-285b-418b-beb9-a45b9a7da4bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:42:59.412631 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7724b718-285b-418b-beb9-a45b9a7da4bf tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.322887 Jun 24 08:42:59.413219 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 108/230] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:42:59 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:42:59.505409 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1309162298", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "networks": [{"uuid": "ff7c78a0-23ea-4cbc-b1dd-1640d90bd5ab"}]}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:42:59.523374 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:59.595171 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] validate_networks() for [('ff7c78a0-23ea-4cbc-b1dd-1640d90bd5ab', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:43:00.032381 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:43:00.033055 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:43:00.033522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:43:00.034076 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:43:00.034632 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:43:00.066750 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:00.095634 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:00.095634 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:00.095634 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:00.118098 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Getting quotas for project 5e6d51dece9847669e9a666633ce634d. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:43:00.123596 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Getting quotas for user 46097d36b6fc4df5b510d279a4648eb7 and project 5e6d51dece9847669e9a666633ce634d. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:43:00.136673 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:43:00.139183 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:43:00.193576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-01b62c79-88b5-49ab-9be9-a2d1ad831731 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:00.195708 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-01b62c79-88b5-49ab-9be9-a2d1ad831731 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:00.210857 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01b62c79-88b5-49ab-9be9-a2d1ad831731 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:00.211961 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01b62c79-88b5-49ab-9be9-a2d1ad831731 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:00.213694 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01b62c79-88b5-49ab-9be9-a2d1ad831731 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:00.214666 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-01b62c79-88b5-49ab-9be9-a2d1ad831731 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:00.224057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-61e9aa1e-8e9a-4476-912c-e06e0742ec20 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721241 Jun 24 08:43:00.225485 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 123/231] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:42:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:43:00.257112 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2e87fdc2-6db3-47de-8f91-d80d6f81db3f tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:00.262158 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2e87fdc2-6db3-47de-8f91-d80d6f81db3f tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:00.287864 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-01b62c79-88b5-49ab-9be9-a2d1ad831731 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:43:00.404543 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2e87fdc2-6db3-47de-8f91-d80d6f81db3f tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:00.413460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2e87fdc2-6db3-47de-8f91-d80d6f81db3f tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1214 microversion: 2.1 time: 0.180405 Jun 24 08:43:00.418735 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 124/232] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:00 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:00.432836 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3476f718-ec27-461a-b733-9c3aabb03a34 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:00.433679 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3476f718-ec27-461a-b733-9c3aabb03a34 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:00.442027 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3476f718-ec27-461a-b733-9c3aabb03a34 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:00.448723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3476f718-ec27-461a-b733-9c3aabb03a34 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:00.450114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3476f718-ec27-461a-b733-9c3aabb03a34 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:00.450798 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3476f718-ec27-461a-b733-9c3aabb03a34 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:00.474111 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-01b62c79-88b5-49ab-9be9-a2d1ad831731 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 204 len: 0 microversion: 2.1 time: 0.286594 Jun 24 08:43:00.480823 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 109/233] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:43:00 2022] DELETE /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:43:00.488455 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-66290407-80e1-4ccc-bb17-50433ab69edd tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:00.489148 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-66290407-80e1-4ccc-bb17-50433ab69edd tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:00.519162 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-66290407-80e1-4ccc-bb17-50433ab69edd tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:00.519651 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-66290407-80e1-4ccc-bb17-50433ab69edd tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:00.521034 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-66290407-80e1-4ccc-bb17-50433ab69edd tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:00.531340 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-66290407-80e1-4ccc-bb17-50433ab69edd tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:00.815125 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3476f718-ec27-461a-b733-9c3aabb03a34 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:00.822755 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-66290407-80e1-4ccc-bb17-50433ab69edd tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:00.846495 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3476f718-ec27-461a-b733-9c3aabb03a34 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.417458 Jun 24 08:43:00.848111 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 125/234] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:00 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:00.849628 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-66290407-80e1-4ccc-bb17-50433ab69edd tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1554 microversion: 2.1 time: 0.365083 Jun 24 08:43:00.850369 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 110/235] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:00 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1554 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:00.859433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1925506423", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:00.909832 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] validate_networks() for None {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:43:01.430799 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-547077ba-ab64-446f-8d7e-a923369ce432 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:01.432544 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-547077ba-ab64-446f-8d7e-a923369ce432 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:01.435106 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:43:01.436337 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:43:01.437002 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:43:01.437349 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:43:01.437876 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:43:01.439733 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-547077ba-ab64-446f-8d7e-a923369ce432 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:01.440565 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-547077ba-ab64-446f-8d7e-a923369ce432 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:01.441808 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-547077ba-ab64-446f-8d7e-a923369ce432 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:01.442859 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-547077ba-ab64-446f-8d7e-a923369ce432 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:01.448354 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:01.448809 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:01.449595 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:01.450023 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:01.468154 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Getting quotas for project 46c24775038b45598100e637f569a117. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:43:01.473257 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Getting quotas for user 19cee9d773b541e186dfe7b90aa73e05 and project 46c24775038b45598100e637f569a117. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:43:01.485736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:43:01.488159 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:43:01.533012 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-547077ba-ab64-446f-8d7e-a923369ce432 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:01.541713 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-547077ba-ab64-446f-8d7e-a923369ce432 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1218 microversion: 2.1 time: 0.115414 Jun 24 08:43:01.542698 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 111/236] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:01 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:01.557925 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1f394ca5-86de-4c46-ab33-7050da04b7dd tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707452 Jun 24 08:43:01.559568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 126/237] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:43:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:43:01.570164 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b1681d15-6759-453a-aacd-e496300f0417 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:01.570761 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b1681d15-6759-453a-aacd-e496300f0417 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:01.646919 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b1681d15-6759-453a-aacd-e496300f0417 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:01.656616 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b1681d15-6759-453a-aacd-e496300f0417 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1215 microversion: 2.1 time: 0.089566 Jun 24 08:43:01.657943 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 112/238] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:01 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:01.865739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-69396692-9520-4030-8ace-e21bab5af574 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:01.866355 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-69396692-9520-4030-8ace-e21bab5af574 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:01.868033 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a2ce3357-4400-4de6-872d-b04f942b0e82 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:01.868635 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a2ce3357-4400-4de6-872d-b04f942b0e82 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:01.874959 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69396692-9520-4030-8ace-e21bab5af574 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:01.875437 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69396692-9520-4030-8ace-e21bab5af574 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:01.881393 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69396692-9520-4030-8ace-e21bab5af574 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:01.881925 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2ce3357-4400-4de6-872d-b04f942b0e82 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:01.882474 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2ce3357-4400-4de6-872d-b04f942b0e82 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:01.883624 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69396692-9520-4030-8ace-e21bab5af574 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:01.884770 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2ce3357-4400-4de6-872d-b04f942b0e82 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:01.885232 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2ce3357-4400-4de6-872d-b04f942b0e82 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:02.216415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a2ce3357-4400-4de6-872d-b04f942b0e82 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:02.220188 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-69396692-9520-4030-8ace-e21bab5af574 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:02.226165 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a2ce3357-4400-4de6-872d-b04f942b0e82 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1554 microversion: 2.1 time: 0.362472 Jun 24 08:43:02.235484 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 113/239] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:01 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1554 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:02.238333 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-69396692-9520-4030-8ace-e21bab5af574 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.377782 Jun 24 08:43:02.239524 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 127/240] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:01 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:02.569629 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b5a64ec2-181a-46f2-bb9d-c7b094c20406 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:02.572177 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b5a64ec2-181a-46f2-bb9d-c7b094c20406 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:02.584831 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5a64ec2-181a-46f2-bb9d-c7b094c20406 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:02.585530 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5a64ec2-181a-46f2-bb9d-c7b094c20406 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:02.586531 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5a64ec2-181a-46f2-bb9d-c7b094c20406 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:02.587198 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5a64ec2-181a-46f2-bb9d-c7b094c20406 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:02.663748 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b5a64ec2-181a-46f2-bb9d-c7b094c20406 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:02.671828 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b5a64ec2-181a-46f2-bb9d-c7b094c20406 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1218 microversion: 2.1 time: 0.115266 Jun 24 08:43:02.677184 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-968e87d7-0c85-4b3d-b512-0bf226a2d279 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:02.678406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-968e87d7-0c85-4b3d-b512-0bf226a2d279 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:02.682228 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 114/241] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:02 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:02.688082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-968e87d7-0c85-4b3d-b512-0bf226a2d279 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:02.688524 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-968e87d7-0c85-4b3d-b512-0bf226a2d279 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:02.689294 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-968e87d7-0c85-4b3d-b512-0bf226a2d279 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:02.689720 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-968e87d7-0c85-4b3d-b512-0bf226a2d279 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:02.761586 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-968e87d7-0c85-4b3d-b512-0bf226a2d279 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:02.772995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-968e87d7-0c85-4b3d-b512-0bf226a2d279 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1219 microversion: 2.1 time: 0.101392 Jun 24 08:43:02.774149 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 128/242] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:02 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:03.243499 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-067ec7bd-af57-4f25-8563-a6fa98f523f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:03.244542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-067ec7bd-af57-4f25-8563-a6fa98f523f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:03.250813 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-067ec7bd-af57-4f25-8563-a6fa98f523f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:03.256725 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e0d7f1a6-e15a-4616-9770-e49bfee84e42 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:03.257593 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e0d7f1a6-e15a-4616-9770-e49bfee84e42 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:03.263133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-067ec7bd-af57-4f25-8563-a6fa98f523f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:03.264580 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-067ec7bd-af57-4f25-8563-a6fa98f523f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:03.266569 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e0d7f1a6-e15a-4616-9770-e49bfee84e42 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:03.267316 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-067ec7bd-af57-4f25-8563-a6fa98f523f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:03.273019 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e0d7f1a6-e15a-4616-9770-e49bfee84e42 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:03.274433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e0d7f1a6-e15a-4616-9770-e49bfee84e42 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:03.275107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e0d7f1a6-e15a-4616-9770-e49bfee84e42 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:03.595861 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-067ec7bd-af57-4f25-8563-a6fa98f523f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:03.604334 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-067ec7bd-af57-4f25-8563-a6fa98f523f7 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1554 microversion: 2.1 time: 0.365061 Jun 24 08:43:03.608204 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e0d7f1a6-e15a-4616-9770-e49bfee84e42 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:03.614906 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 115/243] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:03 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1554 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:03.617246 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e0d7f1a6-e15a-4616-9770-e49bfee84e42 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.364960 Jun 24 08:43:03.617898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 129/244] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:03 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:03.692043 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-29ed7319-c887-416e-bbbb-e7682051022c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:03.693299 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-29ed7319-c887-416e-bbbb-e7682051022c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:03.700402 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-29ed7319-c887-416e-bbbb-e7682051022c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:03.701272 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-29ed7319-c887-416e-bbbb-e7682051022c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:03.702279 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-29ed7319-c887-416e-bbbb-e7682051022c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:03.703464 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-29ed7319-c887-416e-bbbb-e7682051022c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:03.790240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ae473a67-38c0-4bdb-accc-d89a48cd9b5a tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:03.791897 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ae473a67-38c0-4bdb-accc-d89a48cd9b5a tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:03.799484 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ae473a67-38c0-4bdb-accc-d89a48cd9b5a tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:03.800321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ae473a67-38c0-4bdb-accc-d89a48cd9b5a tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:03.801493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ae473a67-38c0-4bdb-accc-d89a48cd9b5a tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:03.802126 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ae473a67-38c0-4bdb-accc-d89a48cd9b5a tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:03.825527 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-29ed7319-c887-416e-bbbb-e7682051022c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:03.840000 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-29ed7319-c887-416e-bbbb-e7682051022c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1218 microversion: 2.1 time: 0.151854 Jun 24 08:43:03.842772 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 116/245] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:03 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1218 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:03.915816 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ae473a67-38c0-4bdb-accc-d89a48cd9b5a tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:03.924022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ae473a67-38c0-4bdb-accc-d89a48cd9b5a tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1219 microversion: 2.1 time: 0.137656 Jun 24 08:43:03.924813 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 130/246] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:03 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:04.627067 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-aceb62ad-ebe9-46f6-a3d7-66527ebf9b76 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:04.627925 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-aceb62ad-ebe9-46f6-a3d7-66527ebf9b76 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:04.633939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6238bf33-a046-4843-bd8a-f5fbd23b707c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:04.635476 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6238bf33-a046-4843-bd8a-f5fbd23b707c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:04.636049 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aceb62ad-ebe9-46f6-a3d7-66527ebf9b76 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:04.636607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aceb62ad-ebe9-46f6-a3d7-66527ebf9b76 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:04.637489 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aceb62ad-ebe9-46f6-a3d7-66527ebf9b76 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:04.638034 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aceb62ad-ebe9-46f6-a3d7-66527ebf9b76 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:04.642869 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6238bf33-a046-4843-bd8a-f5fbd23b707c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:04.643619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6238bf33-a046-4843-bd8a-f5fbd23b707c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:04.644411 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6238bf33-a046-4843-bd8a-f5fbd23b707c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:04.646001 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6238bf33-a046-4843-bd8a-f5fbd23b707c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:05.019323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6238bf33-a046-4843-bd8a-f5fbd23b707c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:05.027976 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-aceb62ad-ebe9-46f6-a3d7-66527ebf9b76 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:05.028740 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6238bf33-a046-4843-bd8a-f5fbd23b707c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.398750 Jun 24 08:43:05.029313 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 131/247] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:04 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:05.035270 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7d4a7e60-b98b-411a-9b12-a114b1471702 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:05.036095 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7d4a7e60-b98b-411a-9b12-a114b1471702 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:05.038928 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-aceb62ad-ebe9-46f6-a3d7-66527ebf9b76 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1554 microversion: 2.1 time: 0.419866 Jun 24 08:43:05.039985 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 117/248] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:04 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1554 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:05.046924 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c97d246f-1999-4e40-8c06-fc760847b970 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:05.051952 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c97d246f-1999-4e40-8c06-fc760847b970 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:05.053267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d4a7e60-b98b-411a-9b12-a114b1471702 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:05.053909 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d4a7e60-b98b-411a-9b12-a114b1471702 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:05.054851 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d4a7e60-b98b-411a-9b12-a114b1471702 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:05.055472 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d4a7e60-b98b-411a-9b12-a114b1471702 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:05.060903 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c97d246f-1999-4e40-8c06-fc760847b970 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:05.060903 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c97d246f-1999-4e40-8c06-fc760847b970 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:05.061158 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c97d246f-1999-4e40-8c06-fc760847b970 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:05.061751 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c97d246f-1999-4e40-8c06-fc760847b970 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:05.156671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7d4a7e60-b98b-411a-9b12-a114b1471702 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:05.165726 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7d4a7e60-b98b-411a-9b12-a114b1471702 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1218 microversion: 2.1 time: 0.135178 Jun 24 08:43:05.167357 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 132/249] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:05 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:05.180735 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c97d246f-1999-4e40-8c06-fc760847b970 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:05.193355 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c97d246f-1999-4e40-8c06-fc760847b970 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1219 microversion: 2.1 time: 0.149529 Jun 24 08:43:05.194226 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 118/250] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:05 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:06.047449 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-34f4eab9-5e5c-4a87-b38c-998c27d02170 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:06.048212 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-34f4eab9-5e5c-4a87-b38c-998c27d02170 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:06.056439 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-34f4eab9-5e5c-4a87-b38c-998c27d02170 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:06.056820 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-27323176-1fc8-45db-95dd-1cd55dea35a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:06.057291 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-34f4eab9-5e5c-4a87-b38c-998c27d02170 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:06.057482 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-27323176-1fc8-45db-95dd-1cd55dea35a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:06.058005 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-34f4eab9-5e5c-4a87-b38c-998c27d02170 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:06.058453 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-34f4eab9-5e5c-4a87-b38c-998c27d02170 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:06.065348 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27323176-1fc8-45db-95dd-1cd55dea35a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:06.066100 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27323176-1fc8-45db-95dd-1cd55dea35a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:06.066960 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27323176-1fc8-45db-95dd-1cd55dea35a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:06.067416 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27323176-1fc8-45db-95dd-1cd55dea35a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:06.309894 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-34f4eab9-5e5c-4a87-b38c-998c27d02170 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:06.319861 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-34f4eab9-5e5c-4a87-b38c-998c27d02170 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.278518 Jun 24 08:43:06.329299 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 133/251] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:06 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:06.329299 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-039b45ab-1d63-48f3-a5db-0aea5cf2ea7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:06.329299 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-039b45ab-1d63-48f3-a5db-0aea5cf2ea7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:06.329656 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-27323176-1fc8-45db-95dd-1cd55dea35a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:06.335242 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-039b45ab-1d63-48f3-a5db-0aea5cf2ea7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:06.335242 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-039b45ab-1d63-48f3-a5db-0aea5cf2ea7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:06.335417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-039b45ab-1d63-48f3-a5db-0aea5cf2ea7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:06.335729 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-039b45ab-1d63-48f3-a5db-0aea5cf2ea7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:06.337327 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-27323176-1fc8-45db-95dd-1cd55dea35a4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1554 microversion: 2.1 time: 0.284643 Jun 24 08:43:06.337902 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 119/252] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:06 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1554 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:06.354510 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-39a63b4d-6600-48c7-ab31-cb0bf5cfd846 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:06.356391 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-39a63b4d-6600-48c7-ab31-cb0bf5cfd846 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:06.368439 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39a63b4d-6600-48c7-ab31-cb0bf5cfd846 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:06.368911 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39a63b4d-6600-48c7-ab31-cb0bf5cfd846 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:06.369687 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39a63b4d-6600-48c7-ab31-cb0bf5cfd846 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:06.370124 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39a63b4d-6600-48c7-ab31-cb0bf5cfd846 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:06.453094 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-039b45ab-1d63-48f3-a5db-0aea5cf2ea7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:06.463766 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-039b45ab-1d63-48f3-a5db-0aea5cf2ea7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1266 microversion: 2.1 time: 0.141583 Jun 24 08:43:06.464907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 134/253] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:06 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:06.471479 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-39a63b4d-6600-48c7-ab31-cb0bf5cfd846 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:06.480298 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-39a63b4d-6600-48c7-ab31-cb0bf5cfd846 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1267 microversion: 2.1 time: 0.132396 Jun 24 08:43:06.481500 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 120/254] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:06 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:07.340400 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a9420cdb-b173-4418-86cf-0f568bf7bb29 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:07.341173 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a9420cdb-b173-4418-86cf-0f568bf7bb29 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:07.354763 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6b6e3682-8cc7-4368-837b-82c2c374048a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:07.355649 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6b6e3682-8cc7-4368-837b-82c2c374048a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:07.371539 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a9420cdb-b173-4418-86cf-0f568bf7bb29 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.371987 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a9420cdb-b173-4418-86cf-0f568bf7bb29 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:07.372765 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a9420cdb-b173-4418-86cf-0f568bf7bb29 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.373193 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a9420cdb-b173-4418-86cf-0f568bf7bb29 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:07.377215 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b6e3682-8cc7-4368-837b-82c2c374048a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.377662 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b6e3682-8cc7-4368-837b-82c2c374048a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:07.378512 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b6e3682-8cc7-4368-837b-82c2c374048a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.379879 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6b6e3682-8cc7-4368-837b-82c2c374048a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:07.415103 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:07.848959 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6b6e3682-8cc7-4368-837b-82c2c374048a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:07.860704 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6b6e3682-8cc7-4368-837b-82c2c374048a tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1554 microversion: 2.1 time: 0.510331 Jun 24 08:43:07.862036 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 121/255] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:07 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1554 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:07.868279 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fb820496-e284-447f-bafa-f1070ce0bb9a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:07.869099 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fb820496-e284-447f-bafa-f1070ce0bb9a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:07.883813 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb820496-e284-447f-bafa-f1070ce0bb9a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.886494 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb820496-e284-447f-bafa-f1070ce0bb9a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:07.891151 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb820496-e284-447f-bafa-f1070ce0bb9a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.893690 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb820496-e284-447f-bafa-f1070ce0bb9a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:07.900331 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a9420cdb-b173-4418-86cf-0f568bf7bb29 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:07.912317 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a9420cdb-b173-4418-86cf-0f568bf7bb29 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.578127 Jun 24 08:43:07.928206 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 135/256] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:07 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:07.932069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:07.945443 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-af593420-d872-4f97-99b9-7c9e5b527818 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:07.946816 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-af593420-d872-4f97-99b9-7c9e5b527818 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:07.965439 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-af593420-d872-4f97-99b9-7c9e5b527818 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.967259 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-af593420-d872-4f97-99b9-7c9e5b527818 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:07.969323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-af593420-d872-4f97-99b9-7c9e5b527818 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:07.970982 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-af593420-d872-4f97-99b9-7c9e5b527818 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:08.326303 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fb820496-e284-447f-bafa-f1070ce0bb9a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:08.340110 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-af593420-d872-4f97-99b9-7c9e5b527818 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:08.348072 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fb820496-e284-447f-bafa-f1070ce0bb9a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1272 microversion: 2.1 time: 0.484704 Jun 24 08:43:08.348653 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 122/257] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:07 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1272 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:08.360575 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-af593420-d872-4f97-99b9-7c9e5b527818 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1273 microversion: 2.1 time: 0.430766 Jun 24 08:43:08.362053 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 136/258] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:07 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1273 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:08.841242 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-7a266cf4-f716-40fb-a782-c10eca802e1e req-33b4f25a-2d1f-4a17-8693-0cef00d0af11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47cbea2-c37b-437e-9f72-539dd1b59f53", "name": "network-vif-deleted", "tag": "78906aae-6d64-4560-9fa5-15138c397c8f"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:08.879795 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-84e914cc-3d1f-4f57-9b54-78dab66f8fc4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:08.880417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-84e914cc-3d1f-4f57-9b54-78dab66f8fc4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:08.881399 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-7a266cf4-f716-40fb-a782-c10eca802e1e req-33b4f25a-2d1f-4a17-8693-0cef00d0af11 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:08.881812 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-7a266cf4-f716-40fb-a782-c10eca802e1e req-33b4f25a-2d1f-4a17-8693-0cef00d0af11 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:08.893202 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84e914cc-3d1f-4f57-9b54-78dab66f8fc4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:08.893671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84e914cc-3d1f-4f57-9b54-78dab66f8fc4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:08.894562 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84e914cc-3d1f-4f57-9b54-78dab66f8fc4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:08.895525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84e914cc-3d1f-4f57-9b54-78dab66f8fc4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:08.930058 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-7a266cf4-f716-40fb-a782-c10eca802e1e req-33b4f25a-2d1f-4a17-8693-0cef00d0af11 service nova] Creating event network-vif-deleted:78906aae-6d64-4560-9fa5-15138c397c8f for instance f47cbea2-c37b-437e-9f72-539dd1b59f53 on hv-cinder-84517 Jun 24 08:43:08.944548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-7a266cf4-f716-40fb-a782-c10eca802e1e req-33b4f25a-2d1f-4a17-8693-0cef00d0af11 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108902 Jun 24 08:43:08.946483 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 123/259] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:08.967380 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-27f9c3c5-609c-40c0-b1dd-c76b2f1bac4b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:08.968423 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-27f9c3c5-609c-40c0-b1dd-c76b2f1bac4b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:08.981256 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27f9c3c5-609c-40c0-b1dd-c76b2f1bac4b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:08.985313 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27f9c3c5-609c-40c0-b1dd-c76b2f1bac4b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:08.986387 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27f9c3c5-609c-40c0-b1dd-c76b2f1bac4b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:08.987798 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27f9c3c5-609c-40c0-b1dd-c76b2f1bac4b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:09.264555 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-84e914cc-3d1f-4f57-9b54-78dab66f8fc4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:09.273121 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-84e914cc-3d1f-4f57-9b54-78dab66f8fc4 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1512 microversion: 2.1 time: 0.397790 Jun 24 08:43:09.282812 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 137/260] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:08 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1512 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:09.366310 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4fc3d25f-0d61-42a9-bd96-63ac12510482 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:09.368068 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4fc3d25f-0d61-42a9-bd96-63ac12510482 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:09.374731 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4fc3d25f-0d61-42a9-bd96-63ac12510482 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:09.375539 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4fc3d25f-0d61-42a9-bd96-63ac12510482 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:09.376553 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4fc3d25f-0d61-42a9-bd96-63ac12510482 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:09.377197 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4fc3d25f-0d61-42a9-bd96-63ac12510482 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:09.601285 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4fc3d25f-0d61-42a9-bd96-63ac12510482 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:09.611141 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4fc3d25f-0d61-42a9-bd96-63ac12510482 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1272 microversion: 2.1 time: 0.249577 Jun 24 08:43:09.617219 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 138/261] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:09 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1272 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:09.644665 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-14e1df7d-fe4f-4c19-a580-5a41dded35c8 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:09.645784 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-14e1df7d-fe4f-4c19-a580-5a41dded35c8 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:09.665228 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14e1df7d-fe4f-4c19-a580-5a41dded35c8 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:09.665839 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14e1df7d-fe4f-4c19-a580-5a41dded35c8 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:09.669124 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-27f9c3c5-609c-40c0-b1dd-c76b2f1bac4b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:09.669347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14e1df7d-fe4f-4c19-a580-5a41dded35c8 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:09.670050 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14e1df7d-fe4f-4c19-a580-5a41dded35c8 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:09.684407 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-27f9c3c5-609c-40c0-b1dd-c76b2f1bac4b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.728951 Jun 24 08:43:09.685044 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 124/262] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:08 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:10.293484 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a6c9152d-859c-440f-a876-37f0bab568fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:10.294076 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a6c9152d-859c-440f-a876-37f0bab568fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:10.303348 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:10.326245 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6c9152d-859c-440f-a876-37f0bab568fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:10.327140 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6c9152d-859c-440f-a876-37f0bab568fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:10.353160 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6c9152d-859c-440f-a876-37f0bab568fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:10.354113 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6c9152d-859c-440f-a876-37f0bab568fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:10.470610 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-14e1df7d-fe4f-4c19-a580-5a41dded35c8 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:10.484956 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6c9152d-859c-440f-a876-37f0bab568fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:10.488341 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6c9152d-859c-440f-a876-37f0bab568fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:10.491747 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-a6c9152d-859c-440f-a876-37f0bab568fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lazy-loading 'fault' on Instance uuid f47cbea2-c37b-437e-9f72-539dd1b59f53 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:43:10.492463 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-14e1df7d-fe4f-4c19-a580-5a41dded35c8 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1315 microversion: 2.1 time: 0.853053 Jun 24 08:43:10.495017 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 139/263] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:09 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1315 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:10.640795 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9d610359-5cd2-4f08-89d8-5f102171d228 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:10.641670 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9d610359-5cd2-4f08-89d8-5f102171d228 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:10.652810 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d610359-5cd2-4f08-89d8-5f102171d228 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:10.657876 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d610359-5cd2-4f08-89d8-5f102171d228 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:10.658763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d610359-5cd2-4f08-89d8-5f102171d228 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:10.659247 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d610359-5cd2-4f08-89d8-5f102171d228 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:10.902308 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a6c9152d-859c-440f-a876-37f0bab568fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83e72cd0d7e47b6bbfc4ffe64b71922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1d15dc76094127a7f84c79dbb3053c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:10.914188 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a6c9152d-859c-440f-a876-37f0bab568fb tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 200 len: 1305 microversion: 2.1 time: 0.625990 Jun 24 08:43:10.927149 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 125/264] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:10 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 1305 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:10.939068 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-59f46cc0-0a12-45e0-813b-2cff8162b813 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:10.940837 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-59f46cc0-0a12-45e0-813b-2cff8162b813 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:10.960072 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59f46cc0-0a12-45e0-813b-2cff8162b813 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:10.960560 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59f46cc0-0a12-45e0-813b-2cff8162b813 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:10.961361 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59f46cc0-0a12-45e0-813b-2cff8162b813 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:10.961361 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59f46cc0-0a12-45e0-813b-2cff8162b813 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:11.459628 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:11.480851 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=14 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:11.654929 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:12.265273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9d610359-5cd2-4f08-89d8-5f102171d228 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:12.274186 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9d610359-5cd2-4f08-89d8-5f102171d228 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1314 microversion: 2.1 time: 1.641427 Jun 24 08:43:12.275052 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 140/265] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:10 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1314 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:12.280234 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e49ac4f4-3c3e-4563-80b0-588d2a03c964 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:12.281101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e49ac4f4-3c3e-4563-80b0-588d2a03c964 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:12.288429 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e49ac4f4-3c3e-4563-80b0-588d2a03c964 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:12.289497 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e49ac4f4-3c3e-4563-80b0-588d2a03c964 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:12.290486 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e49ac4f4-3c3e-4563-80b0-588d2a03c964 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:12.291324 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e49ac4f4-3c3e-4563-80b0-588d2a03c964 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:12.387114 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-59f46cc0-0a12-45e0-813b-2cff8162b813 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:12.396873 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-59f46cc0-0a12-45e0-813b-2cff8162b813 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 1.477944 Jun 24 08:43:12.398119 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 126/266] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:10 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:12.403016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-497f76b5-5beb-4863-b5c8-5754baa24880 req-982ff31f-695d-485d-8581-22b43e1ad640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d5571e-ec6c-4868-88f2-216b6c2fa16f", "tag": "66d8597d-a67a-4e1d-ad61-999cf0fa810e"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:12.414372 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-497f76b5-5beb-4863-b5c8-5754baa24880 req-982ff31f-695d-485d-8581-22b43e1ad640 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:12.415160 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-497f76b5-5beb-4863-b5c8-5754baa24880 req-982ff31f-695d-485d-8581-22b43e1ad640 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:12.431678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-497f76b5-5beb-4863-b5c8-5754baa24880 req-982ff31f-695d-485d-8581-22b43e1ad640 service nova] Creating event network-changed:66d8597d-a67a-4e1d-ad61-999cf0fa810e for instance 48d5571e-ec6c-4868-88f2-216b6c2fa16f on hv-cinder-84517 Jun 24 08:43:12.445742 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-497f76b5-5beb-4863-b5c8-5754baa24880 req-982ff31f-695d-485d-8581-22b43e1ad640 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046019 Jun 24 08:43:12.446357 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 127/267] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:12.454287 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bc74820a-6407-42aa-82e6-ca6813fee2e2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:12.456041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bc74820a-6407-42aa-82e6-ca6813fee2e2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:12.467206 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bc74820a-6407-42aa-82e6-ca6813fee2e2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:12.467956 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bc74820a-6407-42aa-82e6-ca6813fee2e2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:12.468981 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bc74820a-6407-42aa-82e6-ca6813fee2e2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:12.469632 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bc74820a-6407-42aa-82e6-ca6813fee2e2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:12.490443 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-bc74820a-6407-42aa-82e6-ca6813fee2e2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] HTTP exception thrown: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bc74820a-6407-42aa-82e6-ca6813fee2e2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Request method failure captured: Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 HTTP/1.1 Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXjK3H3M81HyL6mWJ9nnnnfhAyXPp5qmEZm39RPzXv_EON6Tv1v81p2hK6_OsuLK0fi9cMpSipUhil6Ehz2BKEjuYNLNmeeuLMFJ5AOdfCTigdJRHenlCqCEh_AHBXHTGP0CIOjIeXNHppw2UJqwVQlFuX1JjMKs-PNNsHsTgO_RVvA Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 6b1d15dc76094127a7f84c79dbb3053c Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-DeleteServersTestJSON-305265227 Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:43:12.499669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:43:12.501263 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b1d15dc76094127a7f84c79dbb3053c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6b1d15dc76094127a7f84c79dbb3053c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6b1d15dc76094127a7f84c79dbb3053c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b1d15dc76094127a7f84c79dbb3053c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:43:12.501263 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-DeleteServersTestJSON-305265227 Jun 24 08:43:12.501263 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 6b1d15dc76094127a7f84c79dbb3053c Jun 24 08:43:12.501263 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-DeleteServersTestJSON-305265227 Jun 24 08:43:12.501263 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-DeleteServersTestJSON-305265227-project Jun 24 08:43:12.501263 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:43:12.501263 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:43:12.501263 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: f83e72cd0d7e47b6bbfc4ffe64b71922 Jun 24 08:43:12.501263 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-DeleteServersTestJSON-305265227-project Jun 24 08:43:12.501263 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:43:12.501263 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:12.501263 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': 'f47cbea2-c37b-437e-9f72-539dd1b59f53'} Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:43:12.502038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:12.503182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:12.516251 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bc74820a-6407-42aa-82e6-ca6813fee2e2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Returning 404 to user: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:43:12.517242 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bc74820a-6407-42aa-82e6-ca6813fee2e2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 404 len: 111 microversion: 2.1 time: 0.069752 Jun 24 08:43:12.521665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 128/268] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:12 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:43:12.682414 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dd7ed917-12f9-4dcf-9de3-75334142b80e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:12.684667 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dd7ed917-12f9-4dcf-9de3-75334142b80e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:12.696091 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd7ed917-12f9-4dcf-9de3-75334142b80e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:12.696302 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd7ed917-12f9-4dcf-9de3-75334142b80e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:12.697050 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd7ed917-12f9-4dcf-9de3-75334142b80e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:12.697599 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd7ed917-12f9-4dcf-9de3-75334142b80e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:12.717820 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-dd7ed917-12f9-4dcf-9de3-75334142b80e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] HTTP exception thrown: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dd7ed917-12f9-4dcf-9de3-75334142b80e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Request method failure captured: Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53/os-volume_attachments HTTP/1.1 Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXjK3H3M81HyL6mWJ9nnnnfhAyXPp5qmEZm39RPzXv_EON6Tv1v81p2hK6_OsuLK0fi9cMpSipUhil6Ehz2BKEjuYNLNmeeuLMFJ5AOdfCTigdJRHenlCqCEh_AHBXHTGP0CIOjIeXNHppw2UJqwVQlFuX1JjMKs-PNNsHsTgO_RVvA Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 6b1d15dc76094127a7f84c79dbb3053c Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-DeleteServersTestJSON-305265227 Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:43:12.720675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:43:12.722347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b1d15dc76094127a7f84c79dbb3053c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6b1d15dc76094127a7f84c79dbb3053c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6b1d15dc76094127a7f84c79dbb3053c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b1d15dc76094127a7f84c79dbb3053c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:43:12.722347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-DeleteServersTestJSON-305265227 Jun 24 08:43:12.722347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 6b1d15dc76094127a7f84c79dbb3053c Jun 24 08:43:12.722347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-DeleteServersTestJSON-305265227 Jun 24 08:43:12.722347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-DeleteServersTestJSON-305265227-project Jun 24 08:43:12.722347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:43:12.722347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:43:12.722347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: f83e72cd0d7e47b6bbfc4ffe64b71922 Jun 24 08:43:12.722347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-DeleteServersTestJSON-305265227-project Jun 24 08:43:12.722347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:43:12.722347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:12.722347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'server_id': 'f47cbea2-c37b-437e-9f72-539dd1b59f53'} Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:43:12.723133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:12.724346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:12.726869 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dd7ed917-12f9-4dcf-9de3-75334142b80e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Returning 404 to user: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:43:12.727937 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dd7ed917-12f9-4dcf-9de3-75334142b80e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050324 Jun 24 08:43:12.728870 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 129/269] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:43:12 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:43:12.772713 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e49ac4f4-3c3e-4563-80b0-588d2a03c964 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:12.782808 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e49ac4f4-3c3e-4563-80b0-588d2a03c964 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1315 microversion: 2.1 time: 0.506323 Jun 24 08:43:12.786442 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 141/270] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:12 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:13.291994 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b916eed8-c340-496d-95ab-3f0882cb78a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:13.292603 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b916eed8-c340-496d-95ab-3f0882cb78a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:13.301357 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b916eed8-c340-496d-95ab-3f0882cb78a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:13.304814 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b916eed8-c340-496d-95ab-3f0882cb78a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:13.305818 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b916eed8-c340-496d-95ab-3f0882cb78a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:13.308681 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b916eed8-c340-496d-95ab-3f0882cb78a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:13.414561 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2251389b-4091-47d8-8af3-320cef0d58e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:13.416827 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2251389b-4091-47d8-8af3-320cef0d58e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:13.424587 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2251389b-4091-47d8-8af3-320cef0d58e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:13.425263 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2251389b-4091-47d8-8af3-320cef0d58e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:13.426722 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2251389b-4091-47d8-8af3-320cef0d58e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:13.428434 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2251389b-4091-47d8-8af3-320cef0d58e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:13.743168 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b916eed8-c340-496d-95ab-3f0882cb78a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:13.777149 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b916eed8-c340-496d-95ab-3f0882cb78a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1314 microversion: 2.1 time: 0.482452 Jun 24 08:43:13.787185 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2251389b-4091-47d8-8af3-320cef0d58e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:13.787686 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 130/271] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:13 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:13.796778 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2251389b-4091-47d8-8af3-320cef0d58e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.385232 Jun 24 08:43:13.799474 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 142/272] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:13 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:13.808906 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-f455fc12-6d1b-4450-acd1-3a717da947cf req-fa8826d0-7249-4aa7-9eb6-814b599dc397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d8c38d0-acf0-4c4a-a953-f1a696644a10", "tag": "82aa1fdb-eee5-4667-ae35-628401d4467a"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:13.809185 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-deaeb6b3-f4aa-4da7-a9c1-c92385b24968 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:13.809813 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-deaeb6b3-f4aa-4da7-a9c1-c92385b24968 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:13.824927 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-deaeb6b3-f4aa-4da7-a9c1-c92385b24968 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:13.825377 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-deaeb6b3-f4aa-4da7-a9c1-c92385b24968 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:13.826182 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-deaeb6b3-f4aa-4da7-a9c1-c92385b24968 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:13.826614 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-deaeb6b3-f4aa-4da7-a9c1-c92385b24968 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:13.838979 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-f455fc12-6d1b-4450-acd1-3a717da947cf req-fa8826d0-7249-4aa7-9eb6-814b599dc397 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:13.839531 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-f455fc12-6d1b-4450-acd1-3a717da947cf req-fa8826d0-7249-4aa7-9eb6-814b599dc397 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:13.869668 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-f455fc12-6d1b-4450-acd1-3a717da947cf req-fa8826d0-7249-4aa7-9eb6-814b599dc397 service nova] Creating event network-changed:82aa1fdb-eee5-4667-ae35-628401d4467a for instance 1d8c38d0-acf0-4c4a-a953-f1a696644a10 on hv-cinder-84517 Jun 24 08:43:13.877664 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-f455fc12-6d1b-4450-acd1-3a717da947cf req-fa8826d0-7249-4aa7-9eb6-814b599dc397 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093597 Jun 24 08:43:13.879817 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 131/273] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:14.083705 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d0e838ff-c261-495a-83f5-9ed4db2e57a2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:14.084668 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d0e838ff-c261-495a-83f5-9ed4db2e57a2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:14.094090 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d0e838ff-c261-495a-83f5-9ed4db2e57a2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:14.094696 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d0e838ff-c261-495a-83f5-9ed4db2e57a2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:14.095658 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d0e838ff-c261-495a-83f5-9ed4db2e57a2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:14.096628 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d0e838ff-c261-495a-83f5-9ed4db2e57a2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:14.114675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-deaeb6b3-f4aa-4da7-a9c1-c92385b24968 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:14.114675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-deaeb6b3-f4aa-4da7-a9c1-c92385b24968 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1315 microversion: 2.1 time: 0.313031 Jun 24 08:43:14.114675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 143/274] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:13 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:14.330957 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-d0e838ff-c261-495a-83f5-9ed4db2e57a2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] HTTP exception thrown: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d0e838ff-c261-495a-83f5-9ed4db2e57a2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Request method failure captured: Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 HTTP/1.1 Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXjK3H3M81HyL6mWJ9nnnnfhAyXPp5qmEZm39RPzXv_EON6Tv1v81p2hK6_OsuLK0fi9cMpSipUhil6Ehz2BKEjuYNLNmeeuLMFJ5AOdfCTigdJRHenlCqCEh_AHBXHTGP0CIOjIeXNHppw2UJqwVQlFuX1JjMKs-PNNsHsTgO_RVvA Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 6b1d15dc76094127a7f84c79dbb3053c Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-DeleteServersTestJSON-305265227 Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:43:14.333829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:43:14.335110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b1d15dc76094127a7f84c79dbb3053c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6b1d15dc76094127a7f84c79dbb3053c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6b1d15dc76094127a7f84c79dbb3053c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b1d15dc76094127a7f84c79dbb3053c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:43:14.335110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-DeleteServersTestJSON-305265227 Jun 24 08:43:14.335110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 6b1d15dc76094127a7f84c79dbb3053c Jun 24 08:43:14.335110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-DeleteServersTestJSON-305265227 Jun 24 08:43:14.335110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-DeleteServersTestJSON-305265227-project Jun 24 08:43:14.335110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:43:14.335110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:43:14.335110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: f83e72cd0d7e47b6bbfc4ffe64b71922 Jun 24 08:43:14.335110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-DeleteServersTestJSON-305265227-project Jun 24 08:43:14.335110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:43:14.335110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:14.335110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': 'f47cbea2-c37b-437e-9f72-539dd1b59f53'} Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:43:14.335992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:14.337398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:14.339854 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d0e838ff-c261-495a-83f5-9ed4db2e57a2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Returning 404 to user: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:43:14.339854 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d0e838ff-c261-495a-83f5-9ed4db2e57a2 tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 404 len: 111 microversion: 2.1 time: 0.260591 Jun 24 08:43:14.339854 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 132/275] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:43:14 2022] DELETE /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 111 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:43:14.344270 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-76d6195e-fd7b-4b5c-9c68-530a92d64e9e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:14.344884 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-76d6195e-fd7b-4b5c-9c68-530a92d64e9e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] [instance: f47cbea2-c37b-437e-9f72-539dd1b59f53] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:14.351281 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-76d6195e-fd7b-4b5c-9c68-530a92d64e9e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:14.352014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-76d6195e-fd7b-4b5c-9c68-530a92d64e9e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:14.352944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-76d6195e-fd7b-4b5c-9c68-530a92d64e9e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:14.353528 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-76d6195e-fd7b-4b5c-9c68-530a92d64e9e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:14.369809 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-76d6195e-fd7b-4b5c-9c68-530a92d64e9e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] HTTP exception thrown: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-76d6195e-fd7b-4b5c-9c68-530a92d64e9e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Request method failure captured: Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 HTTP/1.1 Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXjK3H3M81HyL6mWJ9nnnnfhAyXPp5qmEZm39RPzXv_EON6Tv1v81p2hK6_OsuLK0fi9cMpSipUhil6Ehz2BKEjuYNLNmeeuLMFJ5AOdfCTigdJRHenlCqCEh_AHBXHTGP0CIOjIeXNHppw2UJqwVQlFuX1JjMKs-PNNsHsTgO_RVvA Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 6b1d15dc76094127a7f84c79dbb3053c Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-DeleteServersTestJSON-305265227 Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:43:14.371695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:43:14.373145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b1d15dc76094127a7f84c79dbb3053c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6b1d15dc76094127a7f84c79dbb3053c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6b1d15dc76094127a7f84c79dbb3053c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6b1d15dc76094127a7f84c79dbb3053c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:43:14.373145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-DeleteServersTestJSON-305265227 Jun 24 08:43:14.373145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 6b1d15dc76094127a7f84c79dbb3053c Jun 24 08:43:14.373145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-DeleteServersTestJSON-305265227 Jun 24 08:43:14.373145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-DeleteServersTestJSON-305265227-project Jun 24 08:43:14.373145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:43:14.373145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:43:14.373145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: f83e72cd0d7e47b6bbfc4ffe64b71922 Jun 24 08:43:14.373145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-DeleteServersTestJSON-305265227-project Jun 24 08:43:14.373145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:43:14.373145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:14.373145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': 'f47cbea2-c37b-437e-9f72-539dd1b59f53'} Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:43:14.373958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. Jun 24 08:43:14.375282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:43:14.377885 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-76d6195e-fd7b-4b5c-9c68-530a92d64e9e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] Returning 404 to user: Instance f47cbea2-c37b-437e-9f72-539dd1b59f53 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:43:14.378831 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-76d6195e-fd7b-4b5c-9c68-530a92d64e9e tempest-DeleteServersTestJSON-305265227 tempest-DeleteServersTestJSON-305265227-project] 10.222.0.43 "GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53" status: 404 len: 111 microversion: 2.1 time: 0.038386 Jun 24 08:43:14.380657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 144/276] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:14 2022] GET /compute/v2.1/servers/f47cbea2-c37b-437e-9f72-539dd1b59f53 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:43:14.794231 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a2b178e0-1b5d-48a3-8dd8-2d49138d4e66 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:14.794889 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a2b178e0-1b5d-48a3-8dd8-2d49138d4e66 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:14.802098 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2b178e0-1b5d-48a3-8dd8-2d49138d4e66 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:14.802554 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2b178e0-1b5d-48a3-8dd8-2d49138d4e66 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:14.803510 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2b178e0-1b5d-48a3-8dd8-2d49138d4e66 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:14.804041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2b178e0-1b5d-48a3-8dd8-2d49138d4e66 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:14.815084 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-aa43f29e-7fc4-45f4-92da-62309bae5a97 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:14.815753 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-aa43f29e-7fc4-45f4-92da-62309bae5a97 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:14.822843 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aa43f29e-7fc4-45f4-92da-62309bae5a97 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:14.823644 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aa43f29e-7fc4-45f4-92da-62309bae5a97 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:14.824692 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aa43f29e-7fc4-45f4-92da-62309bae5a97 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:14.828772 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aa43f29e-7fc4-45f4-92da-62309bae5a97 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:15.130822 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a2b178e0-1b5d-48a3-8dd8-2d49138d4e66 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:15.143004 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a2b178e0-1b5d-48a3-8dd8-2d49138d4e66 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1314 microversion: 2.1 time: 0.352815 Jun 24 08:43:15.149164 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 133/277] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:14 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:15.157866 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-04eabd1d-da56-4392-98ba-69e38f6d2931 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:15.158034 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-aa43f29e-7fc4-45f4-92da-62309bae5a97 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:15.158495 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-04eabd1d-da56-4392-98ba-69e38f6d2931 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:15.172232 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04eabd1d-da56-4392-98ba-69e38f6d2931 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:15.173058 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04eabd1d-da56-4392-98ba-69e38f6d2931 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:15.174103 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04eabd1d-da56-4392-98ba-69e38f6d2931 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:15.174723 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04eabd1d-da56-4392-98ba-69e38f6d2931 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:15.183553 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-aa43f29e-7fc4-45f4-92da-62309bae5a97 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.370029 Jun 24 08:43:15.184425 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 145/278] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:14 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:15.487366 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-04eabd1d-da56-4392-98ba-69e38f6d2931 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:15.499192 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-04eabd1d-da56-4392-98ba-69e38f6d2931 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1315 microversion: 2.1 time: 0.348628 Jun 24 08:43:15.500130 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 134/279] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:15 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:16.165653 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-24efa9d8-3318-4a2d-9d74-9b55a155a040 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:16.166268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-24efa9d8-3318-4a2d-9d74-9b55a155a040 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:16.178619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24efa9d8-3318-4a2d-9d74-9b55a155a040 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:16.194517 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24efa9d8-3318-4a2d-9d74-9b55a155a040 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:16.195498 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24efa9d8-3318-4a2d-9d74-9b55a155a040 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:16.195992 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24efa9d8-3318-4a2d-9d74-9b55a155a040 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:16.231620 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-242dd648-bfd4-4ab3-9317-131b92d64684 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:16.232417 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-242dd648-bfd4-4ab3-9317-131b92d64684 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:16.242026 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-242dd648-bfd4-4ab3-9317-131b92d64684 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:16.242667 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-242dd648-bfd4-4ab3-9317-131b92d64684 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:16.243596 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-242dd648-bfd4-4ab3-9317-131b92d64684 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:16.245509 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-242dd648-bfd4-4ab3-9317-131b92d64684 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:16.863403 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-24efa9d8-3318-4a2d-9d74-9b55a155a040 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:16.876867 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-24efa9d8-3318-4a2d-9d74-9b55a155a040 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1314 microversion: 2.1 time: 0.714679 Jun 24 08:43:16.891543 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 146/280] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:16 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:16.909135 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f9a56e4b-6cb9-49bd-b587-876a56f1e928 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:16.909993 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f9a56e4b-6cb9-49bd-b587-876a56f1e928 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:16.917590 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9a56e4b-6cb9-49bd-b587-876a56f1e928 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:16.918282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9a56e4b-6cb9-49bd-b587-876a56f1e928 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:16.927130 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9a56e4b-6cb9-49bd-b587-876a56f1e928 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:16.927937 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9a56e4b-6cb9-49bd-b587-876a56f1e928 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:17.088943 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-242dd648-bfd4-4ab3-9317-131b92d64684 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:17.096925 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-242dd648-bfd4-4ab3-9317-131b92d64684 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.894057 Jun 24 08:43:17.100766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 135/281] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:16 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:17.359738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f9a56e4b-6cb9-49bd-b587-876a56f1e928 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:17.369847 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f9a56e4b-6cb9-49bd-b587-876a56f1e928 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1315 microversion: 2.1 time: 0.473269 Jun 24 08:43:17.371248 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 147/282] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:16 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:17.894195 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f68d2182-2a03-42f0-b117-05e9e887b7b8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:17.895788 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f68d2182-2a03-42f0-b117-05e9e887b7b8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:17.912600 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f68d2182-2a03-42f0-b117-05e9e887b7b8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:17.912953 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f68d2182-2a03-42f0-b117-05e9e887b7b8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:17.915958 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f68d2182-2a03-42f0-b117-05e9e887b7b8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:17.916425 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f68d2182-2a03-42f0-b117-05e9e887b7b8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:18.122630 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a95025f2-ebb5-46ae-a8bb-9bba922ef4f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:18.127443 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a95025f2-ebb5-46ae-a8bb-9bba922ef4f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:18.148770 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a95025f2-ebb5-46ae-a8bb-9bba922ef4f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:18.149225 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a95025f2-ebb5-46ae-a8bb-9bba922ef4f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:18.157104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a95025f2-ebb5-46ae-a8bb-9bba922ef4f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:18.157658 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a95025f2-ebb5-46ae-a8bb-9bba922ef4f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:18.484160 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f68d2182-2a03-42f0-b117-05e9e887b7b8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:18.494426 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f68d2182-2a03-42f0-b117-05e9e887b7b8 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1314 microversion: 2.1 time: 0.604089 Jun 24 08:43:18.498541 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 136/283] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:17 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:18.520236 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-668241b0-b1f1-4b8e-ae50-0790a9b48a43 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:18.521121 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-668241b0-b1f1-4b8e-ae50-0790a9b48a43 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:18.528723 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-668241b0-b1f1-4b8e-ae50-0790a9b48a43 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:18.530003 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-668241b0-b1f1-4b8e-ae50-0790a9b48a43 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:18.531045 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-668241b0-b1f1-4b8e-ae50-0790a9b48a43 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:18.531745 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-668241b0-b1f1-4b8e-ae50-0790a9b48a43 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:18.570115 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a95025f2-ebb5-46ae-a8bb-9bba922ef4f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:18.581713 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a95025f2-ebb5-46ae-a8bb-9bba922ef4f2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.468070 Jun 24 08:43:18.582797 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 148/284] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:18 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:19.146680 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-b5bd719d-d986-4f90-bc50-28d2d119e1fd req-4baf6983-8711-405d-9476-41f050e5c55f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d5571e-ec6c-4868-88f2-216b6c2fa16f", "name": "network-vif-plugged", "status": "completed", "tag": "66d8597d-a67a-4e1d-ad61-999cf0fa810e"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:19.161516 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-b5bd719d-d986-4f90-bc50-28d2d119e1fd req-4baf6983-8711-405d-9476-41f050e5c55f service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:19.163327 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-b5bd719d-d986-4f90-bc50-28d2d119e1fd req-4baf6983-8711-405d-9476-41f050e5c55f service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:19.190421 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-b5bd719d-d986-4f90-bc50-28d2d119e1fd req-4baf6983-8711-405d-9476-41f050e5c55f service nova] Creating event network-vif-plugged:66d8597d-a67a-4e1d-ad61-999cf0fa810e for instance 48d5571e-ec6c-4868-88f2-216b6c2fa16f on hv-cinder-84517 Jun 24 08:43:19.206806 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-b5bd719d-d986-4f90-bc50-28d2d119e1fd req-4baf6983-8711-405d-9476-41f050e5c55f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065290 Jun 24 08:43:19.216836 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 149/285] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:19.244423 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-668241b0-b1f1-4b8e-ae50-0790a9b48a43 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:19.285848 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-668241b0-b1f1-4b8e-ae50-0790a9b48a43 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1315 microversion: 2.1 time: 0.756587 Jun 24 08:43:19.287658 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 137/286] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:18 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:19.516335 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4ee8634c-0c09-4eb7-85be-674cb322bc40 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:19.522560 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4ee8634c-0c09-4eb7-85be-674cb322bc40 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:19.538577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ee8634c-0c09-4eb7-85be-674cb322bc40 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:19.539416 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ee8634c-0c09-4eb7-85be-674cb322bc40 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:19.540901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ee8634c-0c09-4eb7-85be-674cb322bc40 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:19.542398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ee8634c-0c09-4eb7-85be-674cb322bc40 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:19.601742 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2cb4abc0-10a8-4bf4-966a-ea86f2c37175 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:19.602715 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2cb4abc0-10a8-4bf4-966a-ea86f2c37175 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:19.625512 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2cb4abc0-10a8-4bf4-966a-ea86f2c37175 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:19.631443 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2cb4abc0-10a8-4bf4-966a-ea86f2c37175 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:19.635259 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2cb4abc0-10a8-4bf4-966a-ea86f2c37175 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:19.636547 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2cb4abc0-10a8-4bf4-966a-ea86f2c37175 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:19.925233 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4ee8634c-0c09-4eb7-85be-674cb322bc40 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:19.937410 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4ee8634c-0c09-4eb7-85be-674cb322bc40 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1314 microversion: 2.1 time: 0.425761 Jun 24 08:43:19.938377 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 150/287] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:19 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:19.975835 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2cb4abc0-10a8-4bf4-966a-ea86f2c37175 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:19.985783 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2cb4abc0-10a8-4bf4-966a-ea86f2c37175 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.390071 Jun 24 08:43:19.986639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 138/288] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:19 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:20.303751 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f6099bc9-1c14-48f2-ac00-3b822416293f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:20.304636 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f6099bc9-1c14-48f2-ac00-3b822416293f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:20.321199 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f6099bc9-1c14-48f2-ac00-3b822416293f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:20.321914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f6099bc9-1c14-48f2-ac00-3b822416293f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:20.322898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f6099bc9-1c14-48f2-ac00-3b822416293f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:20.323417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f6099bc9-1c14-48f2-ac00-3b822416293f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:20.639758 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f6099bc9-1c14-48f2-ac00-3b822416293f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:20.669402 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f6099bc9-1c14-48f2-ac00-3b822416293f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1315 microversion: 2.1 time: 0.368685 Jun 24 08:43:20.684082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 151/289] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:20 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:20.960296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a06bd082-2ec4-452c-a91b-be2ff215df26 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:20.961495 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a06bd082-2ec4-452c-a91b-be2ff215df26 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:20.975611 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a06bd082-2ec4-452c-a91b-be2ff215df26 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:20.976439 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a06bd082-2ec4-452c-a91b-be2ff215df26 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:20.977408 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a06bd082-2ec4-452c-a91b-be2ff215df26 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:20.982499 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a06bd082-2ec4-452c-a91b-be2ff215df26 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:21.007890 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-23b05087-e9ed-4445-b837-35a6e4ba611a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:21.010007 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-23b05087-e9ed-4445-b837-35a6e4ba611a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:21.026462 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23b05087-e9ed-4445-b837-35a6e4ba611a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:21.026952 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23b05087-e9ed-4445-b837-35a6e4ba611a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:21.031337 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23b05087-e9ed-4445-b837-35a6e4ba611a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:21.031804 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23b05087-e9ed-4445-b837-35a6e4ba611a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:21.493578 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-23b05087-e9ed-4445-b837-35a6e4ba611a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:21.501663 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-23b05087-e9ed-4445-b837-35a6e4ba611a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.501225 Jun 24 08:43:21.506453 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 152/290] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:20 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:21.561623 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a06bd082-2ec4-452c-a91b-be2ff215df26 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:21.581175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a06bd082-2ec4-452c-a91b-be2ff215df26 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1314 microversion: 2.1 time: 0.626111 Jun 24 08:43:21.584862 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 139/291] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:20 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:21.688836 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4cdd9e51-b2c0-4363-9eff-67265068aa0f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:21.689728 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4cdd9e51-b2c0-4363-9eff-67265068aa0f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:21.697115 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4cdd9e51-b2c0-4363-9eff-67265068aa0f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:21.697788 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4cdd9e51-b2c0-4363-9eff-67265068aa0f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:21.698794 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4cdd9e51-b2c0-4363-9eff-67265068aa0f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:21.699408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4cdd9e51-b2c0-4363-9eff-67265068aa0f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:21.726194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:22.024903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4cdd9e51-b2c0-4363-9eff-67265068aa0f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:22.037442 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4cdd9e51-b2c0-4363-9eff-67265068aa0f tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1315 microversion: 2.1 time: 0.349754 Jun 24 08:43:22.048447 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 153/292] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:21 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:22.520694 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3e69c922-c2ce-4308-bdec-b66c49993fa7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:22.521670 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3e69c922-c2ce-4308-bdec-b66c49993fa7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:22.537950 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e69c922-c2ce-4308-bdec-b66c49993fa7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:22.538680 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e69c922-c2ce-4308-bdec-b66c49993fa7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:22.544220 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e69c922-c2ce-4308-bdec-b66c49993fa7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:22.544530 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e69c922-c2ce-4308-bdec-b66c49993fa7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:22.602143 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b4f87e08-c617-449d-a467-a82ea2081b0d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:22.603691 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b4f87e08-c617-449d-a467-a82ea2081b0d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:22.613252 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b4f87e08-c617-449d-a467-a82ea2081b0d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:22.613694 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b4f87e08-c617-449d-a467-a82ea2081b0d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:22.614649 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b4f87e08-c617-449d-a467-a82ea2081b0d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:22.615255 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b4f87e08-c617-449d-a467-a82ea2081b0d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:23.046806 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b4f87e08-c617-449d-a467-a82ea2081b0d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:23.081473 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b4f87e08-c617-449d-a467-a82ea2081b0d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1314 microversion: 2.1 time: 0.480171 Jun 24 08:43:23.086952 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 154/293] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:22 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:23.121704 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-320f4a1c-c033-4c6b-a052-c32b24fda056 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:23.122673 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-320f4a1c-c033-4c6b-a052-c32b24fda056 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:23.132409 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3e69c922-c2ce-4308-bdec-b66c49993fa7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:23.142578 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3e69c922-c2ce-4308-bdec-b66c49993fa7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.626338 Jun 24 08:43:23.143409 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 140/294] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:22 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:23.156629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-320f4a1c-c033-4c6b-a052-c32b24fda056 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:23.157192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-320f4a1c-c033-4c6b-a052-c32b24fda056 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:23.158766 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-320f4a1c-c033-4c6b-a052-c32b24fda056 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:23.160383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-320f4a1c-c033-4c6b-a052-c32b24fda056 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:23.570274 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-320f4a1c-c033-4c6b-a052-c32b24fda056 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:23.591660 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-320f4a1c-c033-4c6b-a052-c32b24fda056 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1464 microversion: 2.1 time: 0.499955 Jun 24 08:43:23.592818 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 155/295] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:23 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1464 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:23.642779 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2c98a5e5-d321-4f1e-a2b8-3be42b34c2d5 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:23.643327 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2c98a5e5-d321-4f1e-a2b8-3be42b34c2d5 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:23.666230 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c98a5e5-d321-4f1e-a2b8-3be42b34c2d5 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:23.668187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c98a5e5-d321-4f1e-a2b8-3be42b34c2d5 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:23.670975 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c98a5e5-d321-4f1e-a2b8-3be42b34c2d5 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:23.671719 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c98a5e5-d321-4f1e-a2b8-3be42b34c2d5 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:23.753602 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2c98a5e5-d321-4f1e-a2b8-3be42b34c2d5 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:43:23.812201 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:23.829610 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-80c71f0f-7557-47a5-a13d-d308b6a93b4a req-863cdc14-d86c-4968-b0cc-fda936416c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d8c38d0-acf0-4c4a-a953-f1a696644a10", "name": "network-vif-plugged", "status": "completed", "tag": "82aa1fdb-eee5-4667-ae35-628401d4467a"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:23.861420 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-80c71f0f-7557-47a5-a13d-d308b6a93b4a req-863cdc14-d86c-4968-b0cc-fda936416c93 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:23.862830 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-80c71f0f-7557-47a5-a13d-d308b6a93b4a req-863cdc14-d86c-4968-b0cc-fda936416c93 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:23.893933 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-80c71f0f-7557-47a5-a13d-d308b6a93b4a req-863cdc14-d86c-4968-b0cc-fda936416c93 service nova] Creating event network-vif-plugged:82aa1fdb-eee5-4667-ae35-628401d4467a for instance 1d8c38d0-acf0-4c4a-a953-f1a696644a10 on hv-cinder-84517 Jun 24 08:43:23.900605 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-80c71f0f-7557-47a5-a13d-d308b6a93b4a req-863cdc14-d86c-4968-b0cc-fda936416c93 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082153 Jun 24 08:43:23.901856 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 156/296] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:43:23.933012 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2c98a5e5-d321-4f1e-a2b8-3be42b34c2d5 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "DELETE /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 204 len: 0 microversion: 2.1 time: 0.293552 Jun 24 08:43:23.933941 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 141/297] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:43:23 2022] DELETE /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:43:23.944191 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b757dbb8-029d-42e7-ad07-c496cddc2fd1 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:23.945009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b757dbb8-029d-42e7-ad07-c496cddc2fd1 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:23.956284 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b757dbb8-029d-42e7-ad07-c496cddc2fd1 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:23.958262 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b757dbb8-029d-42e7-ad07-c496cddc2fd1 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:23.962096 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b757dbb8-029d-42e7-ad07-c496cddc2fd1 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:23.963176 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b757dbb8-029d-42e7-ad07-c496cddc2fd1 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:24.101016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9874ac1d-6e76-4385-be7f-44336af185de tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:24.102173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9874ac1d-6e76-4385-be7f-44336af185de tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:24.115487 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9874ac1d-6e76-4385-be7f-44336af185de tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:24.117032 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9874ac1d-6e76-4385-be7f-44336af185de tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:24.118525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9874ac1d-6e76-4385-be7f-44336af185de tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:24.119435 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9874ac1d-6e76-4385-be7f-44336af185de tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:24.517733 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9874ac1d-6e76-4385-be7f-44336af185de tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:24.525096 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b757dbb8-029d-42e7-ad07-c496cddc2fd1 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:24.527081 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9874ac1d-6e76-4385-be7f-44336af185de tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1314 microversion: 2.1 time: 0.431141 Jun 24 08:43:24.532830 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 142/298] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:24 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:24.533932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b757dbb8-029d-42e7-ad07-c496cddc2fd1 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1470 microversion: 2.1 time: 0.595660 Jun 24 08:43:24.536469 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 157/299] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:23 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1470 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:24.552333 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b88805c8-50ca-4c56-9421-0cef1ac17988 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:24.553090 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b88805c8-50ca-4c56-9421-0cef1ac17988 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:24.566664 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b88805c8-50ca-4c56-9421-0cef1ac17988 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:24.567176 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b88805c8-50ca-4c56-9421-0cef1ac17988 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:24.568627 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b88805c8-50ca-4c56-9421-0cef1ac17988 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:24.569227 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b88805c8-50ca-4c56-9421-0cef1ac17988 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:24.805273 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b88805c8-50ca-4c56-9421-0cef1ac17988 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:24.813653 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b88805c8-50ca-4c56-9421-0cef1ac17988 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.278515 Jun 24 08:43:24.814227 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 143/300] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:24 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:25.555804 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-00b2fb87-2335-4946-8064-000a755fa054 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:25.556412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-00b2fb87-2335-4946-8064-000a755fa054 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:25.556661 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-be1403ec-e814-4fae-ba9d-e97d9eab3027 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:25.557798 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-be1403ec-e814-4fae-ba9d-e97d9eab3027 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:25.569442 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:25.575776 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-be1403ec-e814-4fae-ba9d-e97d9eab3027 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:25.578562 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00b2fb87-2335-4946-8064-000a755fa054 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:25.580505 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00b2fb87-2335-4946-8064-000a755fa054 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:25.581418 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00b2fb87-2335-4946-8064-000a755fa054 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:25.582977 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00b2fb87-2335-4946-8064-000a755fa054 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:25.587443 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-be1403ec-e814-4fae-ba9d-e97d9eab3027 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:25.588267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-be1403ec-e814-4fae-ba9d-e97d9eab3027 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:25.588710 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-be1403ec-e814-4fae-ba9d-e97d9eab3027 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:25.838565 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-be1403ec-e814-4fae-ba9d-e97d9eab3027 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:25.846145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-be1403ec-e814-4fae-ba9d-e97d9eab3027 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1314 microversion: 2.1 time: 0.300983 Jun 24 08:43:25.855597 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-00b2fb87-2335-4946-8064-000a755fa054 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:25.864322 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-00b2fb87-2335-4946-8064-000a755fa054 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1470 microversion: 2.1 time: 0.315691 Jun 24 08:43:25.864851 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 158/301] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:25 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:25.867146 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 144/302] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:25 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1470 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:25.872818 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-49981a96-7772-487b-aa41-2046b7bfa76d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:25.873991 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-49981a96-7772-487b-aa41-2046b7bfa76d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:25.882891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-49981a96-7772-487b-aa41-2046b7bfa76d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:25.883433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-49981a96-7772-487b-aa41-2046b7bfa76d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:25.884514 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-49981a96-7772-487b-aa41-2046b7bfa76d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:25.885198 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-49981a96-7772-487b-aa41-2046b7bfa76d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:26.131078 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-49981a96-7772-487b-aa41-2046b7bfa76d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:26.142116 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-49981a96-7772-487b-aa41-2046b7bfa76d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.275905 Jun 24 08:43:26.146558 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 159/303] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:25 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:26.877235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f788197b-76bc-4fe2-b89f-b0b717052fba tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:26.884325 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-779d0a6f-d373-461a-84e4-877921956512 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:26.886151 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-779d0a6f-d373-461a-84e4-877921956512 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:26.886511 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f788197b-76bc-4fe2-b89f-b0b717052fba tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:26.915166 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f788197b-76bc-4fe2-b89f-b0b717052fba tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:26.917525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-779d0a6f-d373-461a-84e4-877921956512 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:26.918532 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-779d0a6f-d373-461a-84e4-877921956512 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:26.919172 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f788197b-76bc-4fe2-b89f-b0b717052fba tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:26.920686 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-779d0a6f-d373-461a-84e4-877921956512 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:26.922045 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f788197b-76bc-4fe2-b89f-b0b717052fba tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:26.924571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-779d0a6f-d373-461a-84e4-877921956512 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:26.925211 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f788197b-76bc-4fe2-b89f-b0b717052fba tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:27.363967 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f788197b-76bc-4fe2-b89f-b0b717052fba tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:27.373094 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f788197b-76bc-4fe2-b89f-b0b717052fba tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1314 microversion: 2.1 time: 0.499868 Jun 24 08:43:27.377053 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 145/304] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:26 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:27.388357 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8a4b6de6-844b-4e82-8001-071bd37b7f77 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:27.391958 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8a4b6de6-844b-4e82-8001-071bd37b7f77 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:27.407987 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8a4b6de6-844b-4e82-8001-071bd37b7f77 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:27.409381 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8a4b6de6-844b-4e82-8001-071bd37b7f77 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:27.411447 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8a4b6de6-844b-4e82-8001-071bd37b7f77 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:27.414250 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8a4b6de6-844b-4e82-8001-071bd37b7f77 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:27.502255 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-779d0a6f-d373-461a-84e4-877921956512 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:27.516273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-779d0a6f-d373-461a-84e4-877921956512 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1470 microversion: 2.1 time: 0.636323 Jun 24 08:43:27.531005 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 160/305] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:26 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1470 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:27.800336 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8a4b6de6-844b-4e82-8001-071bd37b7f77 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:27.810019 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8a4b6de6-844b-4e82-8001-071bd37b7f77 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.431574 Jun 24 08:43:27.822756 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 146/306] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:27 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:28.080641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-2e493583-13bf-4c0a-bcb1-05db84fef7ef req-087ec231-6495-4cd6-8953-59aa742548f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d5571e-ec6c-4868-88f2-216b6c2fa16f", "name": "network-vif-deleted", "tag": "66d8597d-a67a-4e1d-ad61-999cf0fa810e"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:28.112984 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-2e493583-13bf-4c0a-bcb1-05db84fef7ef req-087ec231-6495-4cd6-8953-59aa742548f1 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:28.113522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-2e493583-13bf-4c0a-bcb1-05db84fef7ef req-087ec231-6495-4cd6-8953-59aa742548f1 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:28.135313 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-2e493583-13bf-4c0a-bcb1-05db84fef7ef req-087ec231-6495-4cd6-8953-59aa742548f1 service nova] Creating event network-vif-deleted:66d8597d-a67a-4e1d-ad61-999cf0fa810e for instance 48d5571e-ec6c-4868-88f2-216b6c2fa16f on hv-cinder-84517 Jun 24 08:43:28.155562 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-2e493583-13bf-4c0a-bcb1-05db84fef7ef req-087ec231-6495-4cd6-8953-59aa742548f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076622 Jun 24 08:43:28.156172 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 161/307] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:28.390344 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-66db2f9d-943b-457c-b9a8-7c5e719b5032 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:28.391703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-66db2f9d-943b-457c-b9a8-7c5e719b5032 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:28.399156 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-66db2f9d-943b-457c-b9a8-7c5e719b5032 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:28.400065 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-66db2f9d-943b-457c-b9a8-7c5e719b5032 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:28.400973 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-66db2f9d-943b-457c-b9a8-7c5e719b5032 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:28.401535 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-66db2f9d-943b-457c-b9a8-7c5e719b5032 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:28.552268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b19f48f0-2297-4fcc-bbc1-984ddc1b0515 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:28.554568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b19f48f0-2297-4fcc-bbc1-984ddc1b0515 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:28.573922 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b19f48f0-2297-4fcc-bbc1-984ddc1b0515 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:28.575373 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b19f48f0-2297-4fcc-bbc1-984ddc1b0515 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:28.577964 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b19f48f0-2297-4fcc-bbc1-984ddc1b0515 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:28.579420 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b19f48f0-2297-4fcc-bbc1-984ddc1b0515 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:28.625371 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-66db2f9d-943b-457c-b9a8-7c5e719b5032 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:28.633815 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-66db2f9d-943b-457c-b9a8-7c5e719b5032 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1314 microversion: 2.1 time: 0.247237 Jun 24 08:43:28.644192 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 147/308] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:28 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:28.658170 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b19f48f0-2297-4fcc-bbc1-984ddc1b0515 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:28.672641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b19f48f0-2297-4fcc-bbc1-984ddc1b0515 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1428 microversion: 2.1 time: 0.138000 Jun 24 08:43:28.673318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 162/309] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:28 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1428 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:28.828837 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e11874e8-02b0-4829-92ca-f549612fd335 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:28.829724 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e11874e8-02b0-4829-92ca-f549612fd335 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:28.837281 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e11874e8-02b0-4829-92ca-f549612fd335 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:28.837931 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e11874e8-02b0-4829-92ca-f549612fd335 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:28.839486 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e11874e8-02b0-4829-92ca-f549612fd335 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:28.840598 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e11874e8-02b0-4829-92ca-f549612fd335 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:29.012146 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e11874e8-02b0-4829-92ca-f549612fd335 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:29.030723 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e11874e8-02b0-4829-92ca-f549612fd335 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1519 microversion: 2.1 time: 0.205501 Jun 24 08:43:29.036625 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 148/310] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:28 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:29.651751 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-12f8ab2f-358c-452a-91ad-31cb756eaf4c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:29.653121 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-12f8ab2f-358c-452a-91ad-31cb756eaf4c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:29.659281 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-12f8ab2f-358c-452a-91ad-31cb756eaf4c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:29.659732 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-12f8ab2f-358c-452a-91ad-31cb756eaf4c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:29.661550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-12f8ab2f-358c-452a-91ad-31cb756eaf4c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:29.662141 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-12f8ab2f-358c-452a-91ad-31cb756eaf4c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:29.689599 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d00b6349-4212-4152-9099-47eb07bbb04d tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:29.690216 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d00b6349-4212-4152-9099-47eb07bbb04d tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:29.697637 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d00b6349-4212-4152-9099-47eb07bbb04d tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:29.707811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d00b6349-4212-4152-9099-47eb07bbb04d tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:29.708614 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d00b6349-4212-4152-9099-47eb07bbb04d tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:29.709052 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d00b6349-4212-4152-9099-47eb07bbb04d tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:29.867767 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d00b6349-4212-4152-9099-47eb07bbb04d tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:29.875425 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d00b6349-4212-4152-9099-47eb07bbb04d tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1300 microversion: 2.1 time: 0.189610 Jun 24 08:43:29.876178 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 149/311] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:29 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:29.935443 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-12f8ab2f-358c-452a-91ad-31cb756eaf4c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:29.944963 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-12f8ab2f-358c-452a-91ad-31cb756eaf4c tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1314 microversion: 2.1 time: 0.297975 Jun 24 08:43:29.946123 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 163/312] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:29 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:30.048847 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-825b8d0a-3537-4542-a2a5-10c2300240e2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:30.049799 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-825b8d0a-3537-4542-a2a5-10c2300240e2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:30.056720 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-825b8d0a-3537-4542-a2a5-10c2300240e2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:30.057428 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-825b8d0a-3537-4542-a2a5-10c2300240e2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:30.059400 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-825b8d0a-3537-4542-a2a5-10c2300240e2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:30.059847 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-825b8d0a-3537-4542-a2a5-10c2300240e2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:30.216443 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-825b8d0a-3537-4542-a2a5-10c2300240e2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:30.224519 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-825b8d0a-3537-4542-a2a5-10c2300240e2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1499 microversion: 2.1 time: 0.179846 Jun 24 08:43:30.227563 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 150/313] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:30 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1499 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:30.243556 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ef46e347-53a3-4ec7-a103-c669472115e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:30.244164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ef46e347-53a3-4ec7-a103-c669472115e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:30.251424 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ef46e347-53a3-4ec7-a103-c669472115e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:30.252059 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ef46e347-53a3-4ec7-a103-c669472115e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:30.253001 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ef46e347-53a3-4ec7-a103-c669472115e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:30.253588 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ef46e347-53a3-4ec7-a103-c669472115e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:30.447794 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ef46e347-53a3-4ec7-a103-c669472115e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:30.456668 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ef46e347-53a3-4ec7-a103-c669472115e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1515 microversion: 2.1 time: 0.217104 Jun 24 08:43:30.458842 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 164/314] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:30 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:30.892306 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a2648c18-f9bd-4346-8aca-c91a6709d469 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:30.892916 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a2648c18-f9bd-4346-8aca-c91a6709d469 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:30.906153 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2648c18-f9bd-4346-8aca-c91a6709d469 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:30.906611 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2648c18-f9bd-4346-8aca-c91a6709d469 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:30.907562 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2648c18-f9bd-4346-8aca-c91a6709d469 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:30.908673 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2648c18-f9bd-4346-8aca-c91a6709d469 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:30.965308 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f16baba6-80ac-4a8c-aba8-24a4eaaa0cbe tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:30.965924 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f16baba6-80ac-4a8c-aba8-24a4eaaa0cbe tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:30.977065 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f16baba6-80ac-4a8c-aba8-24a4eaaa0cbe tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:30.977785 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f16baba6-80ac-4a8c-aba8-24a4eaaa0cbe tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:30.978727 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f16baba6-80ac-4a8c-aba8-24a4eaaa0cbe tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:30.983459 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f16baba6-80ac-4a8c-aba8-24a4eaaa0cbe tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:30.984325 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2648c18-f9bd-4346-8aca-c91a6709d469 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:30.984771 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a2648c18-f9bd-4346-8aca-c91a6709d469 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:30.985223 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-a2648c18-f9bd-4346-8aca-c91a6709d469 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lazy-loading 'fault' on Instance uuid 48d5571e-ec6c-4868-88f2-216b6c2fa16f {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:43:31.056889 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a2648c18-f9bd-4346-8aca-c91a6709d469 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19cee9d773b541e186dfe7b90aa73e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c24775038b45598100e637f569a117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:31.077025 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a2648c18-f9bd-4346-8aca-c91a6709d469 tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 200 len: 1305 microversion: 2.1 time: 0.188440 Jun 24 08:43:31.077974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 151/315] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:30 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 1305 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:31.212619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f16baba6-80ac-4a8c-aba8-24a4eaaa0cbe tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:31.220814 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f16baba6-80ac-4a8c-aba8-24a4eaaa0cbe tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1499 microversion: 2.1 time: 0.262008 Jun 24 08:43:31.221903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 165/316] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:30 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1499 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:32.094707 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b3b06803-d6d7-47fd-9362-24c9fc89ea2e tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:32.096127 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b3b06803-d6d7-47fd-9362-24c9fc89ea2e tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] [instance: 48d5571e-ec6c-4868-88f2-216b6c2fa16f] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:32.108266 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b3b06803-d6d7-47fd-9362-24c9fc89ea2e tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:32.108835 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b3b06803-d6d7-47fd-9362-24c9fc89ea2e tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:32.110491 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b3b06803-d6d7-47fd-9362-24c9fc89ea2e tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:32.111917 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b3b06803-d6d7-47fd-9362-24c9fc89ea2e tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:32.137864 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-b3b06803-d6d7-47fd-9362-24c9fc89ea2e tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] HTTP exception thrown: Instance 48d5571e-ec6c-4868-88f2-216b6c2fa16f could not be found. Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b3b06803-d6d7-47fd-9362-24c9fc89ea2e tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Request method failure captured: Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f HTTP/1.1 Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXkSQpywFvEJ4nfd826XDUvkxO8CvmpQANvDSaHl8Zzr0WnFsBCFDyxLrpTywgKFR73jVdPZDa13fhudv31-2OpL3H86edgOt3g5OBCd6kG0T3mqbTVkTMpDFUFBjsgg_0vVQb-CdqmFxJHMKFekAxHP4V0NyrttuYqbDavOoH1SXjs Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 46c24775038b45598100e637f569a117 Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesNegativeTest-1700616957 Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:43:32.141079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:43:32.142496 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/46c24775038b45598100e637f569a117"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/46c24775038b45598100e637f569a117"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_46c24775038b45598100e637f569a117", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/46c24775038b45598100e637f569a117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:43:32.142496 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesNegativeTest-1700616957 Jun 24 08:43:32.142496 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 46c24775038b45598100e637f569a117 Jun 24 08:43:32.142496 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesNegativeTest-1700616957 Jun 24 08:43:32.142496 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesNegativeTest-1700616957-project Jun 24 08:43:32.142496 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:43:32.142496 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:43:32.142496 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 19cee9d773b541e186dfe7b90aa73e05 Jun 24 08:43:32.142496 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesNegativeTest-1700616957-project Jun 24 08:43:32.142496 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:43:32.142496 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 48d5571e-ec6c-4868-88f2-216b6c2fa16f could not be found. Jun 24 08:43:32.142496 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': '48d5571e-ec6c-4868-88f2-216b6c2fa16f'} Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d5571e-ec6c-4868-88f2-216b6c2fa16f could not be found. Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:43:32.143412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d5571e-ec6c-4868-88f2-216b6c2fa16f could not be found. Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d5571e-ec6c-4868-88f2-216b6c2fa16f could not be found. Jun 24 08:43:32.144665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:32.147249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b3b06803-d6d7-47fd-9362-24c9fc89ea2e tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] Returning 404 to user: Instance 48d5571e-ec6c-4868-88f2-216b6c2fa16f could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:43:32.148687 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b3b06803-d6d7-47fd-9362-24c9fc89ea2e tempest-VolumesNegativeTest-1700616957 tempest-VolumesNegativeTest-1700616957-project] 10.222.0.43 "GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f" status: 404 len: 111 microversion: 2.1 time: 0.058029 Jun 24 08:43:32.150144 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 152/317] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:32 2022] GET /compute/v2.1/servers/48d5571e-ec6c-4868-88f2-216b6c2fa16f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:43:32.418287 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-93dce8ee-50c3-4aa7-ac84-8bfcddf6a411 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:32.418996 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-93dce8ee-50c3-4aa7-ac84-8bfcddf6a411 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:32.427703 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-93dce8ee-50c3-4aa7-ac84-8bfcddf6a411 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:32.428908 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-93dce8ee-50c3-4aa7-ac84-8bfcddf6a411 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:32.429897 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-93dce8ee-50c3-4aa7-ac84-8bfcddf6a411 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:32.430358 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-93dce8ee-50c3-4aa7-ac84-8bfcddf6a411 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:32.474256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-93dce8ee-50c3-4aa7-ac84-8bfcddf6a411 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:43:32.633800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-93dce8ee-50c3-4aa7-ac84-8bfcddf6a411 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 204 len: 0 microversion: 2.1 time: 0.219942 Jun 24 08:43:32.634389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 166/318] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:43:32 2022] DELETE /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:43:32.646131 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-92f80d6d-e303-4812-8894-5c927360f6a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:32.646971 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-92f80d6d-e303-4812-8894-5c927360f6a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:32.680352 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92f80d6d-e303-4812-8894-5c927360f6a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:32.681531 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92f80d6d-e303-4812-8894-5c927360f6a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:32.688377 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92f80d6d-e303-4812-8894-5c927360f6a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:32.690179 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-92f80d6d-e303-4812-8894-5c927360f6a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:33.041034 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-92f80d6d-e303-4812-8894-5c927360f6a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:33.060478 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-92f80d6d-e303-4812-8894-5c927360f6a7 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1505 microversion: 2.1 time: 0.421637 Jun 24 08:43:33.063505 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 153/319] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:32 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:33.169742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-88fccab1-2dd6-42f3-bdc1-0a25bf5916bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:33.171010 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-88fccab1-2dd6-42f3-bdc1-0a25bf5916bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:33.178566 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-88fccab1-2dd6-42f3-bdc1-0a25bf5916bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:33.179431 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-88fccab1-2dd6-42f3-bdc1-0a25bf5916bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:33.180484 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-88fccab1-2dd6-42f3-bdc1-0a25bf5916bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:33.181145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-88fccab1-2dd6-42f3-bdc1-0a25bf5916bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:33.209358 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-88fccab1-2dd6-42f3-bdc1-0a25bf5916bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lazy-loading 'flavor' on Instance uuid 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:43:33.323805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:33.354948 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-88fccab1-2dd6-42f3-bdc1-0a25bf5916bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "POST /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9/action" status: 200 len: 32 microversion: 2.1 time: 0.191990 Jun 24 08:43:33.356521 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 167/320] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Jun 24 08:43:33 2022] POST /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9/action => generated 32 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:43:33.367823 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e02be139-426e-4d88-b8b7-88730f09ca09 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:33.368514 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e02be139-426e-4d88-b8b7-88730f09ca09 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:33.375475 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e02be139-426e-4d88-b8b7-88730f09ca09 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:33.378133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e02be139-426e-4d88-b8b7-88730f09ca09 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:33.378982 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e02be139-426e-4d88-b8b7-88730f09ca09 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:33.379457 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e02be139-426e-4d88-b8b7-88730f09ca09 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:33.561963 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e02be139-426e-4d88-b8b7-88730f09ca09 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:33.571811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e02be139-426e-4d88-b8b7-88730f09ca09 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.210696 Jun 24 08:43:33.583958 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 154/321] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:33 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:33.881131 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e2ccfcbf-077a-48de-ab48-c625d6e1b095 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Action: 'create', calling method: .version_select at 0x7fb75d2b3280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1927289998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsu/9qBfdTfFBTEs2iTD3GPyuPHpQiVD0qV/kKRdKLizrQnqTQiwXTv77ZogPCAZfMCAyjqMyvZtFC9KWIk0cSomGS2ab/6LoHVrQbEN9sApXRLgznuigeoVqoppxJODw=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:33.926319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-e2ccfcbf-077a-48de-ab48-c625d6e1b095 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Getting quotas for project a862170421a346088ab15bc89c9a5716. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:43:33.931239 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-e2ccfcbf-077a-48de-ab48-c625d6e1b095 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Getting quotas for user 4dbbf627f3bf4ffb87c6e23fac0b5002 and project a862170421a346088ab15bc89c9a5716. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:43:34.002388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e2ccfcbf-077a-48de-ab48-c625d6e1b095 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.127344 Jun 24 08:43:34.003152 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 168/322] 10.222.0.43 () {60 vars in 1158 bytes} [Fri Jun 24 08:43:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:34.093073 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c500f3c6-8b89-45ba-8aaf-4736470802d2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:34.093885 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c500f3c6-8b89-45ba-8aaf-4736470802d2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:34.102712 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c500f3c6-8b89-45ba-8aaf-4736470802d2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:34.103286 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c500f3c6-8b89-45ba-8aaf-4736470802d2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:34.104224 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c500f3c6-8b89-45ba-8aaf-4736470802d2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:34.104905 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c500f3c6-8b89-45ba-8aaf-4736470802d2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:34.148182 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-29384334", "imageRef": "e11580e5-171d-4707-9ec9-995b16ad3141", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1927289998", "networks": [{"uuid": "86cb7a03-aaa2-4c5b-a286-f59847774ae7"}]}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:34.291132 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] validate_networks() for [('86cb7a03-aaa2-4c5b-a286-f59847774ae7', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:43:34.456283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c500f3c6-8b89-45ba-8aaf-4736470802d2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:34.465949 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c500f3c6-8b89-45ba-8aaf-4736470802d2 tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1505 microversion: 2.1 time: 0.378723 Jun 24 08:43:34.466858 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 155/323] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:34 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:34.601948 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0aa1c2f7-34d0-4140-b849-59779e16b4ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:34.602630 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0aa1c2f7-34d0-4140-b849-59779e16b4ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:34.625634 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0aa1c2f7-34d0-4140-b849-59779e16b4ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:34.626345 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0aa1c2f7-34d0-4140-b849-59779e16b4ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:34.627166 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0aa1c2f7-34d0-4140-b849-59779e16b4ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:34.627631 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0aa1c2f7-34d0-4140-b849-59779e16b4ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:34.891253 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:43:34.891253 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:43:34.891903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:43:34.893166 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:43:34.893166 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:43:34.895797 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0aa1c2f7-34d0-4140-b849-59779e16b4ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:34.904276 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0aa1c2f7-34d0-4140-b849-59779e16b4ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.307012 Jun 24 08:43:34.904613 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 156/324] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:34 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:34.913350 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:34.914234 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:34.915426 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:34.916378 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:34.937342 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Getting quotas for project a862170421a346088ab15bc89c9a5716. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:43:34.941989 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Getting quotas for user 4dbbf627f3bf4ffb87c6e23fac0b5002 and project a862170421a346088ab15bc89c9a5716. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:43:34.961399 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:43:34.966484 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e11580e5-171d-4707-9ec9-995b16ad3141',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:43:35.027586 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-24e33359-4484-46a6-944b-a7beff7f0b16 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884322 Jun 24 08:43:35.028962 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 169/325] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:43:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:43:35.039407 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4ac91f30-9a4a-4090-b273-179454ba0d31 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:35.041637 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4ac91f30-9a4a-4090-b273-179454ba0d31 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:35.155542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4ac91f30-9a4a-4090-b273-179454ba0d31 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:35.189570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4ac91f30-9a4a-4090-b273-179454ba0d31 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1257 microversion: 2.1 time: 0.154311 Jun 24 08:43:35.190545 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 157/326] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:35 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:35.484834 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5942093d-d613-44af-a285-ad6f6e834f7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:35.485458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5942093d-d613-44af-a285-ad6f6e834f7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:35.502008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5942093d-d613-44af-a285-ad6f6e834f7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:35.502460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5942093d-d613-44af-a285-ad6f6e834f7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:35.505889 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5942093d-d613-44af-a285-ad6f6e834f7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:35.507347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5942093d-d613-44af-a285-ad6f6e834f7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:35.757638 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5942093d-d613-44af-a285-ad6f6e834f7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:35.765516 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5942093d-d613-44af-a285-ad6f6e834f7a tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1505 microversion: 2.1 time: 0.285271 Jun 24 08:43:35.766152 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 170/327] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:35 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1505 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:35.923973 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e2c67ae6-0b08-4508-a171-1c3c4a4c36d4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:35.924737 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e2c67ae6-0b08-4508-a171-1c3c4a4c36d4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:35.939336 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2c67ae6-0b08-4508-a171-1c3c4a4c36d4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:35.939792 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2c67ae6-0b08-4508-a171-1c3c4a4c36d4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:35.940573 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2c67ae6-0b08-4508-a171-1c3c4a4c36d4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:35.943810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2c67ae6-0b08-4508-a171-1c3c4a4c36d4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.054606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-99cee796-69b3-4be6-98ec-bd3ee0517c53 req-8e56e0b8-6b9a-4b6f-a75a-4f5c69ff69d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d8c38d0-acf0-4c4a-a953-f1a696644a10", "name": "network-vif-deleted", "tag": "82aa1fdb-eee5-4667-ae35-628401d4467a"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:36.087399 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-99cee796-69b3-4be6-98ec-bd3ee0517c53 req-8e56e0b8-6b9a-4b6f-a75a-4f5c69ff69d0 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:36.087903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-99cee796-69b3-4be6-98ec-bd3ee0517c53 req-8e56e0b8-6b9a-4b6f-a75a-4f5c69ff69d0 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.122418 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-99cee796-69b3-4be6-98ec-bd3ee0517c53 req-8e56e0b8-6b9a-4b6f-a75a-4f5c69ff69d0 service nova] Creating event network-vif-deleted:82aa1fdb-eee5-4667-ae35-628401d4467a for instance 1d8c38d0-acf0-4c4a-a953-f1a696644a10 on hv-cinder-84517 Jun 24 08:43:36.134830 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-99cee796-69b3-4be6-98ec-bd3ee0517c53 req-8e56e0b8-6b9a-4b6f-a75a-4f5c69ff69d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084295 Jun 24 08:43:36.135463 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 171/328] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:43:36.205042 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e2c67ae6-0b08-4508-a171-1c3c4a4c36d4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:36.210004 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a5ee8ee8-1930-4c54-a846-c18450bba8ab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:36.212248 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a5ee8ee8-1930-4c54-a846-c18450bba8ab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:36.213600 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:36.217644 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e2c67ae6-0b08-4508-a171-1c3c4a4c36d4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.298949 Jun 24 08:43:36.218402 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 158/329] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:35 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:36.234146 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5ee8ee8-1930-4c54-a846-c18450bba8ab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:36.235013 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5ee8ee8-1930-4c54-a846-c18450bba8ab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.236329 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5ee8ee8-1930-4c54-a846-c18450bba8ab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:36.240654 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5ee8ee8-1930-4c54-a846-c18450bba8ab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.347746 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a5ee8ee8-1930-4c54-a846-c18450bba8ab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:36.358332 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a5ee8ee8-1930-4c54-a846-c18450bba8ab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1309 microversion: 2.1 time: 0.155460 Jun 24 08:43:36.359119 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 172/330] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:36 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1309 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:36.782938 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6770c23c-3665-4202-b87c-347e99fd3b3d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:36.784006 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6770c23c-3665-4202-b87c-347e99fd3b3d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:36.795235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6770c23c-3665-4202-b87c-347e99fd3b3d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:36.795854 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6770c23c-3665-4202-b87c-347e99fd3b3d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.796797 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6770c23c-3665-4202-b87c-347e99fd3b3d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:36.797380 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6770c23c-3665-4202-b87c-347e99fd3b3d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.852167 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6770c23c-3665-4202-b87c-347e99fd3b3d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:36.852623 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6770c23c-3665-4202-b87c-347e99fd3b3d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:36.853072 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-6770c23c-3665-4202-b87c-347e99fd3b3d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lazy-loading 'fault' on Instance uuid 1d8c38d0-acf0-4c4a-a953-f1a696644a10 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:43:36.904176 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6770c23c-3665-4202-b87c-347e99fd3b3d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46097d36b6fc4df5b510d279a4648eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6d51dece9847669e9a666633ce634d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:36.915661 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6770c23c-3665-4202-b87c-347e99fd3b3d tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 200 len: 1304 microversion: 2.1 time: 0.136912 Jun 24 08:43:36.916747 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 159/331] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:36 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:37.239734 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-50c9172b-c2f7-401a-ac4b-e860cb75c6f7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:37.241082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-50c9172b-c2f7-401a-ac4b-e860cb75c6f7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:37.248577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-50c9172b-c2f7-401a-ac4b-e860cb75c6f7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:37.249467 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-50c9172b-c2f7-401a-ac4b-e860cb75c6f7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:37.250239 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-50c9172b-c2f7-401a-ac4b-e860cb75c6f7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:37.250943 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-50c9172b-c2f7-401a-ac4b-e860cb75c6f7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:37.376711 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d5bc4c50-3244-4a53-b345-80e6b0bdfa10 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:37.377333 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d5bc4c50-3244-4a53-b345-80e6b0bdfa10 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:37.384896 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5bc4c50-3244-4a53-b345-80e6b0bdfa10 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:37.385662 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5bc4c50-3244-4a53-b345-80e6b0bdfa10 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:37.386826 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5bc4c50-3244-4a53-b345-80e6b0bdfa10 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:37.388067 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5bc4c50-3244-4a53-b345-80e6b0bdfa10 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:37.519966 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d5bc4c50-3244-4a53-b345-80e6b0bdfa10 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:37.527880 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d5bc4c50-3244-4a53-b345-80e6b0bdfa10 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1315 microversion: 2.1 time: 0.155404 Jun 24 08:43:37.529081 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 160/332] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:37 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:37.535567 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-50c9172b-c2f7-401a-ac4b-e860cb75c6f7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:37.544994 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-50c9172b-c2f7-401a-ac4b-e860cb75c6f7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.311110 Jun 24 08:43:37.546091 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 173/333] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:37 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:37.937118 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3bcdb108-b7e5-4270-8a7c-4751115eb8dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:37.937930 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3bcdb108-b7e5-4270-8a7c-4751115eb8dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] [instance: 1d8c38d0-acf0-4c4a-a953-f1a696644a10] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:37.950994 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bcdb108-b7e5-4270-8a7c-4751115eb8dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:37.953011 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bcdb108-b7e5-4270-8a7c-4751115eb8dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:37.955688 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bcdb108-b7e5-4270-8a7c-4751115eb8dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:37.959296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bcdb108-b7e5-4270-8a7c-4751115eb8dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:37.996067 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-3bcdb108-b7e5-4270-8a7c-4751115eb8dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] HTTP exception thrown: Instance 1d8c38d0-acf0-4c4a-a953-f1a696644a10 could not be found. Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3bcdb108-b7e5-4270-8a7c-4751115eb8dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Request method failure captured: Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 HTTP/1.1 Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXjnjG37TMVBnZW7tEgM1_K_fuwOv_AR2Jb9rlT36vWXXAv0lBF0FfYvEykCDQLnM_3sjLHYR6805tfrVn1o1J53RKRO0ReeHuA59m_9aLe1rcVuZNBcZwmv4jYNgJvdXLIjRI7PWpB9XGvcrJbrrQuTJ1ZMDAvp1VkMo4x7XQjIasM Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 5e6d51dece9847669e9a666633ce634d Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesActionsTest-1978318296 Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:43:38.007404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:43:38.009008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e6d51dece9847669e9a666633ce634d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5e6d51dece9847669e9a666633ce634d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5e6d51dece9847669e9a666633ce634d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e6d51dece9847669e9a666633ce634d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:43:38.009008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesActionsTest-1978318296 Jun 24 08:43:38.009008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 5e6d51dece9847669e9a666633ce634d Jun 24 08:43:38.009008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesActionsTest-1978318296 Jun 24 08:43:38.009008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesActionsTest-1978318296-project Jun 24 08:43:38.009008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:43:38.009008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:43:38.009008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 46097d36b6fc4df5b510d279a4648eb7 Jun 24 08:43:38.009008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesActionsTest-1978318296-project Jun 24 08:43:38.009008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:43:38.009008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 1d8c38d0-acf0-4c4a-a953-f1a696644a10 could not be found. Jun 24 08:43:38.009008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': '1d8c38d0-acf0-4c4a-a953-f1a696644a10'} Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d8c38d0-acf0-4c4a-a953-f1a696644a10 could not be found. Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:43:38.009877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d8c38d0-acf0-4c4a-a953-f1a696644a10 could not be found. Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d8c38d0-acf0-4c4a-a953-f1a696644a10 could not be found. Jun 24 08:43:38.011376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:43:38.012841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3bcdb108-b7e5-4270-8a7c-4751115eb8dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] Returning 404 to user: Instance 1d8c38d0-acf0-4c4a-a953-f1a696644a10 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:43:38.012841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3bcdb108-b7e5-4270-8a7c-4751115eb8dc tempest-VolumesActionsTest-1978318296 tempest-VolumesActionsTest-1978318296-project] 10.222.0.43 "GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10" status: 404 len: 111 microversion: 2.1 time: 0.079304 Jun 24 08:43:38.015764 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 161/334] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:37 2022] GET /compute/v2.1/servers/1d8c38d0-acf0-4c4a-a953-f1a696644a10 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:43:38.545425 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4a0cf05f-c176-491a-bb87-be31b05c10fc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:38.546329 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4a0cf05f-c176-491a-bb87-be31b05c10fc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:38.570220 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-916edbdf-f445-4954-9148-7f67e439b6d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:38.570984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-916edbdf-f445-4954-9148-7f67e439b6d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:38.571344 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a0cf05f-c176-491a-bb87-be31b05c10fc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:38.571806 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a0cf05f-c176-491a-bb87-be31b05c10fc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:38.572598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a0cf05f-c176-491a-bb87-be31b05c10fc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:38.573025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4a0cf05f-c176-491a-bb87-be31b05c10fc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:38.580428 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-916edbdf-f445-4954-9148-7f67e439b6d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:38.581064 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-916edbdf-f445-4954-9148-7f67e439b6d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:38.581972 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-916edbdf-f445-4954-9148-7f67e439b6d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:38.582504 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-916edbdf-f445-4954-9148-7f67e439b6d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:39.049058 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-916edbdf-f445-4954-9148-7f67e439b6d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:39.057272 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-916edbdf-f445-4954-9148-7f67e439b6d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.494025 Jun 24 08:43:39.057834 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 162/335] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:38 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:39.338581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4a0cf05f-c176-491a-bb87-be31b05c10fc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:39.354818 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4a0cf05f-c176-491a-bb87-be31b05c10fc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.805817 Jun 24 08:43:39.361431 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 174/336] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:38 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:40.075559 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cb0d28b8-c8ad-4e95-b81f-a8584a573dd1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:40.076783 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cb0d28b8-c8ad-4e95-b81f-a8584a573dd1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:40.105038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb0d28b8-c8ad-4e95-b81f-a8584a573dd1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:40.107792 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb0d28b8-c8ad-4e95-b81f-a8584a573dd1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:40.108840 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb0d28b8-c8ad-4e95-b81f-a8584a573dd1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:40.114028 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cb0d28b8-c8ad-4e95-b81f-a8584a573dd1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:40.141545 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-8156abab-e664-48b6-aabb-1d21fa77950f req-a9ee0246-5f33-406c-a045-84488e852e45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9754407b-6b66-4af9-8f31-452cfbbf19e4", "tag": "506af44b-105c-48b6-b580-5fa177c6e0f3"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:40.157179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-8156abab-e664-48b6-aabb-1d21fa77950f req-a9ee0246-5f33-406c-a045-84488e852e45 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:40.157625 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-8156abab-e664-48b6-aabb-1d21fa77950f req-a9ee0246-5f33-406c-a045-84488e852e45 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:40.214356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-8156abab-e664-48b6-aabb-1d21fa77950f req-a9ee0246-5f33-406c-a045-84488e852e45 service nova] Creating event network-changed:506af44b-105c-48b6-b580-5fa177c6e0f3 for instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 on hv-cinder-84517 Jun 24 08:43:40.227517 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-8156abab-e664-48b6-aabb-1d21fa77950f req-a9ee0246-5f33-406c-a045-84488e852e45 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094585 Jun 24 08:43:40.228729 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 175/337] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:43:40.368789 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-dd067bd3-02d5-45bd-afc0-946167282895 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:40.372014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-dd067bd3-02d5-45bd-afc0-946167282895 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:40.386267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dd067bd3-02d5-45bd-afc0-946167282895 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:40.386788 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dd067bd3-02d5-45bd-afc0-946167282895 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:40.387517 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dd067bd3-02d5-45bd-afc0-946167282895 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:40.395447 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dd067bd3-02d5-45bd-afc0-946167282895 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:40.902522 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cb0d28b8-c8ad-4e95-b81f-a8584a573dd1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:40.918719 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cb0d28b8-c8ad-4e95-b81f-a8584a573dd1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.846399 Jun 24 08:43:40.930673 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 163/338] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:40 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:41.084907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-dd067bd3-02d5-45bd-afc0-946167282895 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:41.095759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-dd067bd3-02d5-45bd-afc0-946167282895 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.734110 Jun 24 08:43:41.097023 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 176/339] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:40 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:41.947679 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3bc77122-0ea8-4db5-9d8d-5d05020b09ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:41.948277 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3bc77122-0ea8-4db5-9d8d-5d05020b09ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:41.951020 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:41.959662 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bc77122-0ea8-4db5-9d8d-5d05020b09ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:41.960117 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bc77122-0ea8-4db5-9d8d-5d05020b09ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:41.960916 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bc77122-0ea8-4db5-9d8d-5d05020b09ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:41.965397 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bc77122-0ea8-4db5-9d8d-5d05020b09ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:42.112958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4dbf2afb-6beb-4f01-b554-4b20a4478c53 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:42.113538 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4dbf2afb-6beb-4f01-b554-4b20a4478c53 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:42.119513 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4dbf2afb-6beb-4f01-b554-4b20a4478c53 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:42.119955 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4dbf2afb-6beb-4f01-b554-4b20a4478c53 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:42.120708 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4dbf2afb-6beb-4f01-b554-4b20a4478c53 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:42.121136 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4dbf2afb-6beb-4f01-b554-4b20a4478c53 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:42.375581 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3bc77122-0ea8-4db5-9d8d-5d05020b09ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:42.384007 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3bc77122-0ea8-4db5-9d8d-5d05020b09ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.440427 Jun 24 08:43:42.384969 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 164/340] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:41 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:42.424120 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4dbf2afb-6beb-4f01-b554-4b20a4478c53 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:42.432046 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4dbf2afb-6beb-4f01-b554-4b20a4478c53 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.322899 Jun 24 08:43:42.443948 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 177/341] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:42 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:43.406367 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-efbf9bc9-7e19-4d1e-87f5-a45128669885 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:43.406367 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-efbf9bc9-7e19-4d1e-87f5-a45128669885 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:43.416754 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efbf9bc9-7e19-4d1e-87f5-a45128669885 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:43.417451 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efbf9bc9-7e19-4d1e-87f5-a45128669885 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:43.418210 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efbf9bc9-7e19-4d1e-87f5-a45128669885 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:43.418638 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efbf9bc9-7e19-4d1e-87f5-a45128669885 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:43.453389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4ec13f08-a292-4a89-887a-a2a5d28c074a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:43.453998 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4ec13f08-a292-4a89-887a-a2a5d28c074a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:43.473169 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ec13f08-a292-4a89-887a-a2a5d28c074a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:43.473622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ec13f08-a292-4a89-887a-a2a5d28c074a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:43.474392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ec13f08-a292-4a89-887a-a2a5d28c074a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:43.474819 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4ec13f08-a292-4a89-887a-a2a5d28c074a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:43.872830 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-efbf9bc9-7e19-4d1e-87f5-a45128669885 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:43.875859 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4ec13f08-a292-4a89-887a-a2a5d28c074a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:43.884805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4ec13f08-a292-4a89-887a-a2a5d28c074a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.435207 Jun 24 08:43:43.886478 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-efbf9bc9-7e19-4d1e-87f5-a45128669885 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.485384 Jun 24 08:43:43.898038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 165/342] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:43 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:43.901526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 178/343] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:43 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:44.903988 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c5023aa9-4edf-4cbe-8c88-85ae5dc3f1d3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:44.904612 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c5023aa9-4edf-4cbe-8c88-85ae5dc3f1d3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:44.905252 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e254cd45-48a1-4533-a6a3-3b725109f3e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:44.906392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e254cd45-48a1-4533-a6a3-3b725109f3e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:44.920557 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e254cd45-48a1-4533-a6a3-3b725109f3e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:44.921070 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c5023aa9-4edf-4cbe-8c88-85ae5dc3f1d3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:44.921789 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c5023aa9-4edf-4cbe-8c88-85ae5dc3f1d3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:44.922579 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c5023aa9-4edf-4cbe-8c88-85ae5dc3f1d3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:44.922880 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e254cd45-48a1-4533-a6a3-3b725109f3e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:44.923736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e254cd45-48a1-4533-a6a3-3b725109f3e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:44.924315 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e254cd45-48a1-4533-a6a3-3b725109f3e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:44.924941 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c5023aa9-4edf-4cbe-8c88-85ae5dc3f1d3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:44.928940 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:44.981285 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=10 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:45.166756 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:45.400804 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c5023aa9-4edf-4cbe-8c88-85ae5dc3f1d3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:45.409122 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e254cd45-48a1-4533-a6a3-3b725109f3e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:45.419480 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c5023aa9-4edf-4cbe-8c88-85ae5dc3f1d3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.518229 Jun 24 08:43:45.420559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e254cd45-48a1-4533-a6a3-3b725109f3e7 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.520258 Jun 24 08:43:45.430611 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 166/344] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:44 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:45.436371 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 179/345] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:44 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:46.442110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0cf9ec2c-ca3b-4811-98cb-258a473d60a8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:46.451037 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-85d4e538-882d-43d7-aa0e-bc09b0814f0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:46.452291 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-85d4e538-882d-43d7-aa0e-bc09b0814f0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:46.455134 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0cf9ec2c-ca3b-4811-98cb-258a473d60a8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:46.468635 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-85d4e538-882d-43d7-aa0e-bc09b0814f0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:46.472958 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0cf9ec2c-ca3b-4811-98cb-258a473d60a8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:46.476837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-85d4e538-882d-43d7-aa0e-bc09b0814f0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:46.484518 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0cf9ec2c-ca3b-4811-98cb-258a473d60a8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:46.485358 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0cf9ec2c-ca3b-4811-98cb-258a473d60a8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:46.485865 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0cf9ec2c-ca3b-4811-98cb-258a473d60a8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:46.494709 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-85d4e538-882d-43d7-aa0e-bc09b0814f0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:46.495704 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-85d4e538-882d-43d7-aa0e-bc09b0814f0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:46.847952 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-85d4e538-882d-43d7-aa0e-bc09b0814f0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:46.862506 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-85d4e538-882d-43d7-aa0e-bc09b0814f0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.412640 Jun 24 08:43:46.864257 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 180/346] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:46 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:46.866700 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0cf9ec2c-ca3b-4811-98cb-258a473d60a8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:46.893578 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0cf9ec2c-ca3b-4811-98cb-258a473d60a8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.459253 Jun 24 08:43:46.894750 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 167/347] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:46 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:47.881109 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5392c296-69b5-4244-8675-9115d7104e54 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:47.881734 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5392c296-69b5-4244-8675-9115d7104e54 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:47.887876 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5392c296-69b5-4244-8675-9115d7104e54 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:47.888331 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5392c296-69b5-4244-8675-9115d7104e54 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:47.889115 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5392c296-69b5-4244-8675-9115d7104e54 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:47.889550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5392c296-69b5-4244-8675-9115d7104e54 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:47.910294 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ec517544-37ab-4727-84d3-52a5ed7e3056 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:47.911938 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ec517544-37ab-4727-84d3-52a5ed7e3056 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:47.925166 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ec517544-37ab-4727-84d3-52a5ed7e3056 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:47.937441 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ec517544-37ab-4727-84d3-52a5ed7e3056 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:47.938880 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ec517544-37ab-4727-84d3-52a5ed7e3056 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:47.939409 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ec517544-37ab-4727-84d3-52a5ed7e3056 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:48.130433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5392c296-69b5-4244-8675-9115d7104e54 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:48.146774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5392c296-69b5-4244-8675-9115d7104e54 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.269555 Jun 24 08:43:48.149801 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 181/348] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:47 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:48.186474 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ec517544-37ab-4727-84d3-52a5ed7e3056 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:48.198236 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ec517544-37ab-4727-84d3-52a5ed7e3056 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.291944 Jun 24 08:43:48.198676 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 168/349] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:47 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:49.165714 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8fee612c-4084-4177-81f8-2a61dd9d87e6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:49.167052 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8fee612c-4084-4177-81f8-2a61dd9d87e6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:49.183987 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8fee612c-4084-4177-81f8-2a61dd9d87e6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:49.184707 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8fee612c-4084-4177-81f8-2a61dd9d87e6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:49.186856 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8fee612c-4084-4177-81f8-2a61dd9d87e6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:49.188008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8fee612c-4084-4177-81f8-2a61dd9d87e6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:49.217565 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-39ccf081-a816-4269-93f0-7a46fbc26011 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:49.218172 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-39ccf081-a816-4269-93f0-7a46fbc26011 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:49.242669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39ccf081-a816-4269-93f0-7a46fbc26011 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:49.243335 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39ccf081-a816-4269-93f0-7a46fbc26011 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:49.252008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39ccf081-a816-4269-93f0-7a46fbc26011 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:49.252467 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39ccf081-a816-4269-93f0-7a46fbc26011 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:49.445541 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8fee612c-4084-4177-81f8-2a61dd9d87e6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:49.458325 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8fee612c-4084-4177-81f8-2a61dd9d87e6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.296882 Jun 24 08:43:49.459593 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 182/350] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:49 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:49.505563 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-39ccf081-a816-4269-93f0-7a46fbc26011 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:49.513593 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-39ccf081-a816-4269-93f0-7a46fbc26011 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.299884 Jun 24 08:43:49.514171 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 169/351] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:49 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:50.479820 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f34d22ca-11f1-4900-887c-0e6ff5e3f8d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:50.480752 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f34d22ca-11f1-4900-887c-0e6ff5e3f8d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:50.489479 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f34d22ca-11f1-4900-887c-0e6ff5e3f8d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:50.490752 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f34d22ca-11f1-4900-887c-0e6ff5e3f8d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:50.491890 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f34d22ca-11f1-4900-887c-0e6ff5e3f8d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:50.493222 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f34d22ca-11f1-4900-887c-0e6ff5e3f8d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:50.530025 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8b7af898-24b8-48d5-b0f4-da27afcf9405 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:50.530922 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8b7af898-24b8-48d5-b0f4-da27afcf9405 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:50.538062 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b7af898-24b8-48d5-b0f4-da27afcf9405 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:50.543783 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b7af898-24b8-48d5-b0f4-da27afcf9405 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:50.544712 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b7af898-24b8-48d5-b0f4-da27afcf9405 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:50.545261 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b7af898-24b8-48d5-b0f4-da27afcf9405 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:50.948993 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f34d22ca-11f1-4900-887c-0e6ff5e3f8d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:50.962112 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f34d22ca-11f1-4900-887c-0e6ff5e3f8d9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.486935 Jun 24 08:43:50.972369 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 183/352] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:50 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:50.982243 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8b7af898-24b8-48d5-b0f4-da27afcf9405 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:50.990300 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8b7af898-24b8-48d5-b0f4-da27afcf9405 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.463996 Jun 24 08:43:51.002695 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 170/353] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:50 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:51.981407 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c527317a-9e1b-4044-a767-94161647a86d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:51.982032 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c527317a-9e1b-4044-a767-94161647a86d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:52.011762 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-db7ef997-ebc7-4ab6-9b66-81822a5e55c1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:52.013007 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-db7ef997-ebc7-4ab6-9b66-81822a5e55c1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:52.016645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c527317a-9e1b-4044-a767-94161647a86d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:52.018049 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c527317a-9e1b-4044-a767-94161647a86d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:52.021106 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c527317a-9e1b-4044-a767-94161647a86d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:52.021672 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c527317a-9e1b-4044-a767-94161647a86d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:52.030368 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-db7ef997-ebc7-4ab6-9b66-81822a5e55c1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:52.037481 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-db7ef997-ebc7-4ab6-9b66-81822a5e55c1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:52.038326 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-db7ef997-ebc7-4ab6-9b66-81822a5e55c1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:52.038774 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-db7ef997-ebc7-4ab6-9b66-81822a5e55c1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:52.461261 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c527317a-9e1b-4044-a767-94161647a86d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:52.470164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c527317a-9e1b-4044-a767-94161647a86d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.494783 Jun 24 08:43:52.471046 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 184/354] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:51 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:52.511074 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-db7ef997-ebc7-4ab6-9b66-81822a5e55c1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:52.524395 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-db7ef997-ebc7-4ab6-9b66-81822a5e55c1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.516765 Jun 24 08:43:52.525136 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 171/355] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:52 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:53.488711 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-16dd7819-d1ba-4eb2-8921-d5e3dbf6f23e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:53.489336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-16dd7819-d1ba-4eb2-8921-d5e3dbf6f23e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:53.505230 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-16dd7819-d1ba-4eb2-8921-d5e3dbf6f23e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:53.505684 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-16dd7819-d1ba-4eb2-8921-d5e3dbf6f23e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:53.506772 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-16dd7819-d1ba-4eb2-8921-d5e3dbf6f23e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:53.508353 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-16dd7819-d1ba-4eb2-8921-d5e3dbf6f23e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:53.541604 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-475a5225-f1bc-4cdd-a40f-efc229b7a55e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:53.542214 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-475a5225-f1bc-4cdd-a40f-efc229b7a55e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:53.557091 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-475a5225-f1bc-4cdd-a40f-efc229b7a55e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:53.557549 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-475a5225-f1bc-4cdd-a40f-efc229b7a55e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:53.558332 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-475a5225-f1bc-4cdd-a40f-efc229b7a55e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:53.558779 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-475a5225-f1bc-4cdd-a40f-efc229b7a55e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:53.830925 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-16dd7819-d1ba-4eb2-8921-d5e3dbf6f23e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:53.849478 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-16dd7819-d1ba-4eb2-8921-d5e3dbf6f23e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.365093 Jun 24 08:43:53.852009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 185/356] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:53 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:53.873072 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-475a5225-f1bc-4cdd-a40f-efc229b7a55e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:53.882884 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-475a5225-f1bc-4cdd-a40f-efc229b7a55e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.345040 Jun 24 08:43:53.895876 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 172/357] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:53 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:54.078936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e809fcdf-873e-414e-95ca-8d5365367613 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Action: 'create', calling method: .version_select at 0x7fb75d39bd30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1763929295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnQhkXS5+BjEq6pl+oFNWfa1TQnDqCZ82r3prPJxLRyEpiJ8jr3+fPoksYa69WPBGZ8sXtSRjfp2ZDCXr7uX1OaWieVkT9PLY9wIouv/YH8MD0R14cx4Q0pdngg5Qr9Dg=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:54.101201 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-e809fcdf-873e-414e-95ca-8d5365367613 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Getting quotas for project d567a9e7ba344ca4ac65b276b57995d1. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:43:54.106159 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-e809fcdf-873e-414e-95ca-8d5365367613 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Getting quotas for user 7eb223c95f794ebd8d34f3a8627dfd89 and project d567a9e7ba344ca4ac65b276b57995d1. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:43:54.139639 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e809fcdf-873e-414e-95ca-8d5365367613 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.286400 Jun 24 08:43:54.140543 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 186/358] 10.222.0.43 () {60 vars in 1158 bytes} [Fri Jun 24 08:43:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:54.872137 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1471141c-2367-40e3-9901-ac7437db3793 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:54.872816 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1471141c-2367-40e3-9901-ac7437db3793 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:54.914851 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8bf51650-b1fb-4213-b3b2-8172891a6bfa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:54.916776 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8bf51650-b1fb-4213-b3b2-8172891a6bfa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:54.926546 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:54.936718 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1471141c-2367-40e3-9901-ac7437db3793 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:54.937259 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1471141c-2367-40e3-9901-ac7437db3793 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:54.942319 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1471141c-2367-40e3-9901-ac7437db3793 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:54.943455 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1471141c-2367-40e3-9901-ac7437db3793 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:54.977752 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8bf51650-b1fb-4213-b3b2-8172891a6bfa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:54.979005 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8bf51650-b1fb-4213-b3b2-8172891a6bfa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:54.981205 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8bf51650-b1fb-4213-b3b2-8172891a6bfa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:54.982117 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8bf51650-b1fb-4213-b3b2-8172891a6bfa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:55.513604 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1471141c-2367-40e3-9901-ac7437db3793 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:55.528740 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1471141c-2367-40e3-9901-ac7437db3793 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.660982 Jun 24 08:43:55.530264 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 173/359] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:54 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:55.699988 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8bf51650-b1fb-4213-b3b2-8172891a6bfa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:55.724763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8bf51650-b1fb-4213-b3b2-8172891a6bfa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.815611 Jun 24 08:43:55.729980 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 187/360] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:54 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:56.557602 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3248b3f1-edb9-400d-8adb-ec18a8e707f6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:56.558537 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3248b3f1-edb9-400d-8adb-ec18a8e707f6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:56.569034 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3248b3f1-edb9-400d-8adb-ec18a8e707f6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:56.569734 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3248b3f1-edb9-400d-8adb-ec18a8e707f6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:56.570738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3248b3f1-edb9-400d-8adb-ec18a8e707f6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:56.571405 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3248b3f1-edb9-400d-8adb-ec18a8e707f6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:56.740061 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3248b3f1-edb9-400d-8adb-ec18a8e707f6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:56.745668 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-31f75a6a-e803-40e9-ae25-7adfec95fd1e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:56.746339 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-31f75a6a-e803-40e9-ae25-7adfec95fd1e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:56.748781 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3248b3f1-edb9-400d-8adb-ec18a8e707f6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.202570 Jun 24 08:43:56.749334 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 174/361] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:56 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:56.765744 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31f75a6a-e803-40e9-ae25-7adfec95fd1e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:56.766804 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31f75a6a-e803-40e9-ae25-7adfec95fd1e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:56.768091 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31f75a6a-e803-40e9-ae25-7adfec95fd1e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:56.768894 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31f75a6a-e803-40e9-ae25-7adfec95fd1e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:56.775404 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:56.958219 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-31f75a6a-e803-40e9-ae25-7adfec95fd1e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:56.966365 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-31f75a6a-e803-40e9-ae25-7adfec95fd1e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.224433 Jun 24 08:43:56.967104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 188/362] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:56 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:57.766461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d8184b2f-db02-4bee-8e82-b7a34528d8b2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:57.767063 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d8184b2f-db02-4bee-8e82-b7a34528d8b2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:57.773477 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8184b2f-db02-4bee-8e82-b7a34528d8b2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:57.773915 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8184b2f-db02-4bee-8e82-b7a34528d8b2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:57.774667 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8184b2f-db02-4bee-8e82-b7a34528d8b2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:57.775094 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8184b2f-db02-4bee-8e82-b7a34528d8b2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:57.903818 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d8184b2f-db02-4bee-8e82-b7a34528d8b2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:57.907478 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:57.912781 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d8184b2f-db02-4bee-8e82-b7a34528d8b2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.150209 Jun 24 08:43:57.913363 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 175/363] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:57 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:57.983759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2752a690-7bc5-46bb-b13e-6974a571dac1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:57.984375 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2752a690-7bc5-46bb-b13e-6974a571dac1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:57.990367 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2752a690-7bc5-46bb-b13e-6974a571dac1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:57.990819 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2752a690-7bc5-46bb-b13e-6974a571dac1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:57.991617 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2752a690-7bc5-46bb-b13e-6974a571dac1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:57.992050 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2752a690-7bc5-46bb-b13e-6974a571dac1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:58.117618 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2752a690-7bc5-46bb-b13e-6974a571dac1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:58.125002 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2752a690-7bc5-46bb-b13e-6974a571dac1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.145129 Jun 24 08:43:58.125558 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 189/364] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:57 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:58.930706 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-be4f6fdd-d072-4e61-8568-f569a55dd816 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:58.931362 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-be4f6fdd-d072-4e61-8568-f569a55dd816 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:58.937717 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be4f6fdd-d072-4e61-8568-f569a55dd816 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:58.938158 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be4f6fdd-d072-4e61-8568-f569a55dd816 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:58.938915 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be4f6fdd-d072-4e61-8568-f569a55dd816 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:58.939366 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-be4f6fdd-d072-4e61-8568-f569a55dd816 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:59.086783 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-be4f6fdd-d072-4e61-8568-f569a55dd816 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:59.094356 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-be4f6fdd-d072-4e61-8568-f569a55dd816 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.167515 Jun 24 08:43:59.094967 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 176/365] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:58 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:59.142022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a604086a-33f4-48b1-85ad-12f75eabce7a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:59.142811 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a604086a-33f4-48b1-85ad-12f75eabce7a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:59.149798 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a604086a-33f4-48b1-85ad-12f75eabce7a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:59.150579 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a604086a-33f4-48b1-85ad-12f75eabce7a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:59.151489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a604086a-33f4-48b1-85ad-12f75eabce7a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:59.152082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a604086a-33f4-48b1-85ad-12f75eabce7a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:59.303059 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a604086a-33f4-48b1-85ad-12f75eabce7a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:59.311043 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a604086a-33f4-48b1-85ad-12f75eabce7a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.172956 Jun 24 08:43:59.311630 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 190/366] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:59 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:00.111752 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4680e66b-8f99-433d-83b0-44c4d0aa63ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:00.112371 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4680e66b-8f99-433d-83b0-44c4d0aa63ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:00.119092 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4680e66b-8f99-433d-83b0-44c4d0aa63ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:00.119595 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4680e66b-8f99-433d-83b0-44c4d0aa63ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:00.120367 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4680e66b-8f99-433d-83b0-44c4d0aa63ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:00.120805 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4680e66b-8f99-433d-83b0-44c4d0aa63ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:00.265789 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4680e66b-8f99-433d-83b0-44c4d0aa63ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:00.281835 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4680e66b-8f99-433d-83b0-44c4d0aa63ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.173847 Jun 24 08:44:00.293482 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 177/367] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:00 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:00.329105 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9297ac1b-fb2a-41b2-9cf5-77f20f4fb56b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:00.329807 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9297ac1b-fb2a-41b2-9cf5-77f20f4fb56b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:00.341067 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9297ac1b-fb2a-41b2-9cf5-77f20f4fb56b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:00.341587 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9297ac1b-fb2a-41b2-9cf5-77f20f4fb56b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:00.344304 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9297ac1b-fb2a-41b2-9cf5-77f20f4fb56b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:00.344755 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9297ac1b-fb2a-41b2-9cf5-77f20f4fb56b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:00.502410 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9297ac1b-fb2a-41b2-9cf5-77f20f4fb56b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:00.510214 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9297ac1b-fb2a-41b2-9cf5-77f20f4fb56b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.185739 Jun 24 08:44:00.512433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 191/368] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:00 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:01.301513 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-16bde031-096b-4407-b210-7071f061c38e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:01.306222 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-16bde031-096b-4407-b210-7071f061c38e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:01.315586 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16bde031-096b-4407-b210-7071f061c38e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:01.316036 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16bde031-096b-4407-b210-7071f061c38e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:01.321060 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16bde031-096b-4407-b210-7071f061c38e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:01.321508 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16bde031-096b-4407-b210-7071f061c38e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:01.529635 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ac0cfbf6-357b-491b-a43f-5e76ff50f115 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:01.531069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ac0cfbf6-357b-491b-a43f-5e76ff50f115 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:01.541352 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ac0cfbf6-357b-491b-a43f-5e76ff50f115 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:01.541813 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ac0cfbf6-357b-491b-a43f-5e76ff50f115 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:01.542871 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ac0cfbf6-357b-491b-a43f-5e76ff50f115 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:01.543336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ac0cfbf6-357b-491b-a43f-5e76ff50f115 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:01.568268 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-16bde031-096b-4407-b210-7071f061c38e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:01.584288 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-16bde031-096b-4407-b210-7071f061c38e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.287316 Jun 24 08:44:01.590757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 178/369] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:01 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:01.715903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ac0cfbf6-357b-491b-a43f-5e76ff50f115 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:01.724628 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ac0cfbf6-357b-491b-a43f-5e76ff50f115 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.199177 Jun 24 08:44:01.725484 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 192/370] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:01 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:02.603481 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4a643c2f-cd14-4ac5-b2b5-a3b4652258a9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:02.604199 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4a643c2f-cd14-4ac5-b2b5-a3b4652258a9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:02.616483 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a643c2f-cd14-4ac5-b2b5-a3b4652258a9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:02.618261 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a643c2f-cd14-4ac5-b2b5-a3b4652258a9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:02.619251 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a643c2f-cd14-4ac5-b2b5-a3b4652258a9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:02.619952 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4a643c2f-cd14-4ac5-b2b5-a3b4652258a9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:02.747550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7cb8a318-ab98-47ec-9d63-33d1192cd238 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:02.748286 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7cb8a318-ab98-47ec-9d63-33d1192cd238 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:02.774337 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7cb8a318-ab98-47ec-9d63-33d1192cd238 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:02.774999 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7cb8a318-ab98-47ec-9d63-33d1192cd238 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:02.780239 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7cb8a318-ab98-47ec-9d63-33d1192cd238 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:02.780600 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7cb8a318-ab98-47ec-9d63-33d1192cd238 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:02.932546 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4a643c2f-cd14-4ac5-b2b5-a3b4652258a9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:02.943387 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4a643c2f-cd14-4ac5-b2b5-a3b4652258a9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.344678 Jun 24 08:44:02.944462 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 179/371] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:02 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:03.026670 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7cb8a318-ab98-47ec-9d63-33d1192cd238 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:03.036969 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7cb8a318-ab98-47ec-9d63-33d1192cd238 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.297946 Jun 24 08:44:03.038933 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 193/372] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:02 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:03.964749 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1d32ba2c-2658-41e3-a364-bf29be18e29a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:03.966440 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1d32ba2c-2658-41e3-a364-bf29be18e29a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:03.975031 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1d32ba2c-2658-41e3-a364-bf29be18e29a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:03.976080 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1d32ba2c-2658-41e3-a364-bf29be18e29a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:03.977703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1d32ba2c-2658-41e3-a364-bf29be18e29a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:03.978548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1d32ba2c-2658-41e3-a364-bf29be18e29a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:04.055245 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1b80ff5d-40c8-45be-b193-41b7bff7319a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:04.056528 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1b80ff5d-40c8-45be-b193-41b7bff7319a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:04.066045 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b80ff5d-40c8-45be-b193-41b7bff7319a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:04.068002 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b80ff5d-40c8-45be-b193-41b7bff7319a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:04.071904 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b80ff5d-40c8-45be-b193-41b7bff7319a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:04.072862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b80ff5d-40c8-45be-b193-41b7bff7319a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:04.142387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:04.296121 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1d32ba2c-2658-41e3-a364-bf29be18e29a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:04.331053 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1d32ba2c-2658-41e3-a364-bf29be18e29a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.370488 Jun 24 08:44:04.333167 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 180/373] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:03 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:04.404100 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1b80ff5d-40c8-45be-b193-41b7bff7319a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:04.413952 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1b80ff5d-40c8-45be-b193-41b7bff7319a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.362931 Jun 24 08:44:04.415007 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 194/374] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:04 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:05.351710 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f268dec5-8590-41f0-971a-dd6fc8133483 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:05.353068 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f268dec5-8590-41f0-971a-dd6fc8133483 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:05.360297 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f268dec5-8590-41f0-971a-dd6fc8133483 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:05.361049 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f268dec5-8590-41f0-971a-dd6fc8133483 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:05.362308 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f268dec5-8590-41f0-971a-dd6fc8133483 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:05.363508 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f268dec5-8590-41f0-971a-dd6fc8133483 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:05.439360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b8eb045b-f065-4b8a-ae28-fbb900891e7e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:05.441682 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b8eb045b-f065-4b8a-ae28-fbb900891e7e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:05.450720 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b8eb045b-f065-4b8a-ae28-fbb900891e7e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:05.451565 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b8eb045b-f065-4b8a-ae28-fbb900891e7e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:05.452706 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b8eb045b-f065-4b8a-ae28-fbb900891e7e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:05.453305 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b8eb045b-f065-4b8a-ae28-fbb900891e7e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:05.583330 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f268dec5-8590-41f0-971a-dd6fc8133483 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:05.593320 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f268dec5-8590-41f0-971a-dd6fc8133483 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.246617 Jun 24 08:44:05.606572 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 181/375] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:05 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:05.666141 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b8eb045b-f065-4b8a-ae28-fbb900891e7e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:05.677469 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b8eb045b-f065-4b8a-ae28-fbb900891e7e tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.247888 Jun 24 08:44:05.678496 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 195/376] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:05 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:06.611796 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0028060e-dd64-4bd6-b199-cda8545554ae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:06.612560 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0028060e-dd64-4bd6-b199-cda8545554ae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:06.620008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0028060e-dd64-4bd6-b199-cda8545554ae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:06.620759 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0028060e-dd64-4bd6-b199-cda8545554ae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:06.621769 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0028060e-dd64-4bd6-b199-cda8545554ae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:06.622417 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0028060e-dd64-4bd6-b199-cda8545554ae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:06.694537 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e45d77b1-e1e6-44b1-8044-febf421fd601 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:06.695303 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e45d77b1-e1e6-44b1-8044-febf421fd601 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:06.702566 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e45d77b1-e1e6-44b1-8044-febf421fd601 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:06.703590 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e45d77b1-e1e6-44b1-8044-febf421fd601 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:06.704713 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e45d77b1-e1e6-44b1-8044-febf421fd601 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:06.705371 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e45d77b1-e1e6-44b1-8044-febf421fd601 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:06.819839 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0028060e-dd64-4bd6-b199-cda8545554ae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:06.828100 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0028060e-dd64-4bd6-b199-cda8545554ae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.220872 Jun 24 08:44:06.841188 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 182/377] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:06 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:06.921198 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e45d77b1-e1e6-44b1-8044-febf421fd601 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:06.930830 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e45d77b1-e1e6-44b1-8044-febf421fd601 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.240646 Jun 24 08:44:06.932057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 196/378] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:06 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:07.848793 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-27c57736-b57e-4037-8c43-556a96e63ccc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:07.849399 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-27c57736-b57e-4037-8c43-556a96e63ccc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:07.855800 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27c57736-b57e-4037-8c43-556a96e63ccc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.856247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27c57736-b57e-4037-8c43-556a96e63ccc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:07.857002 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27c57736-b57e-4037-8c43-556a96e63ccc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.857430 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27c57736-b57e-4037-8c43-556a96e63ccc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:07.947771 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d9049a23-de64-4256-b9c6-0a2d7af238bd tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:07.948929 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d9049a23-de64-4256-b9c6-0a2d7af238bd tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:07.956119 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9049a23-de64-4256-b9c6-0a2d7af238bd tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.957206 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9049a23-de64-4256-b9c6-0a2d7af238bd tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:07.958007 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9049a23-de64-4256-b9c6-0a2d7af238bd tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.958426 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d9049a23-de64-4256-b9c6-0a2d7af238bd tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:07.990480 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-27c57736-b57e-4037-8c43-556a96e63ccc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:07.998072 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-27c57736-b57e-4037-8c43-556a96e63ccc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.153618 Jun 24 08:44:07.998640 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 183/379] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:07 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:08.093678 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d9049a23-de64-4256-b9c6-0a2d7af238bd tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:08.102499 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d9049a23-de64-4256-b9c6-0a2d7af238bd tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.158460 Jun 24 08:44:08.103120 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 197/380] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:07 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:09.016008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c9d14cba-7fdd-49af-acd9-1ac5c02d456c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:09.016672 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c9d14cba-7fdd-49af-acd9-1ac5c02d456c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:09.023763 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9d14cba-7fdd-49af-acd9-1ac5c02d456c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:09.024274 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9d14cba-7fdd-49af-acd9-1ac5c02d456c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:09.025052 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9d14cba-7fdd-49af-acd9-1ac5c02d456c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:09.025497 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c9d14cba-7fdd-49af-acd9-1ac5c02d456c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:09.121161 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-028e7e8e-a493-4928-a7d8-3bbf896605e5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:09.122339 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-028e7e8e-a493-4928-a7d8-3bbf896605e5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:09.131133 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-028e7e8e-a493-4928-a7d8-3bbf896605e5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:09.131631 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-028e7e8e-a493-4928-a7d8-3bbf896605e5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:09.132595 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-028e7e8e-a493-4928-a7d8-3bbf896605e5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:09.133329 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-028e7e8e-a493-4928-a7d8-3bbf896605e5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:09.302464 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c9d14cba-7fdd-49af-acd9-1ac5c02d456c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:09.312193 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c9d14cba-7fdd-49af-acd9-1ac5c02d456c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.299571 Jun 24 08:44:09.312807 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 184/381] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:09 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:09.438346 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-028e7e8e-a493-4928-a7d8-3bbf896605e5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:09.455315 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-028e7e8e-a493-4928-a7d8-3bbf896605e5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.339389 Jun 24 08:44:09.456695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 198/382] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:09 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:10.331386 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-db1caf41-f07e-44d1-b49a-9e58ca04a8de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:10.332000 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-db1caf41-f07e-44d1-b49a-9e58ca04a8de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:10.338003 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-db1caf41-f07e-44d1-b49a-9e58ca04a8de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:10.338455 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-db1caf41-f07e-44d1-b49a-9e58ca04a8de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:10.339227 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-db1caf41-f07e-44d1-b49a-9e58ca04a8de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:10.339672 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-db1caf41-f07e-44d1-b49a-9e58ca04a8de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:10.471795 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6a94f1e8-dfc4-45ae-83aa-5f841502a4ea tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:10.472523 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6a94f1e8-dfc4-45ae-83aa-5f841502a4ea tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:10.479542 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6a94f1e8-dfc4-45ae-83aa-5f841502a4ea tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:10.480061 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6a94f1e8-dfc4-45ae-83aa-5f841502a4ea tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:10.480888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6a94f1e8-dfc4-45ae-83aa-5f841502a4ea tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:10.481581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6a94f1e8-dfc4-45ae-83aa-5f841502a4ea tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:10.532683 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-db1caf41-f07e-44d1-b49a-9e58ca04a8de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:10.542605 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-db1caf41-f07e-44d1-b49a-9e58ca04a8de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.215198 Jun 24 08:44:10.543896 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 185/383] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:10 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:10.642544 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6a94f1e8-dfc4-45ae-83aa-5f841502a4ea tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:10.653618 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6a94f1e8-dfc4-45ae-83aa-5f841502a4ea tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.185791 Jun 24 08:44:10.654883 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 199/384] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:10 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:11.560672 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eadd376f-a53a-45c3-b29a-4987ab1b2b46 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:11.561949 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eadd376f-a53a-45c3-b29a-4987ab1b2b46 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:11.570691 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eadd376f-a53a-45c3-b29a-4987ab1b2b46 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:11.571391 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eadd376f-a53a-45c3-b29a-4987ab1b2b46 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:11.572448 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eadd376f-a53a-45c3-b29a-4987ab1b2b46 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:11.573117 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eadd376f-a53a-45c3-b29a-4987ab1b2b46 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:11.673874 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c5f67e56-5fb5-4d12-b3c4-f9d00db71dab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:11.676787 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c5f67e56-5fb5-4d12-b3c4-f9d00db71dab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:11.696192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c5f67e56-5fb5-4d12-b3c4-f9d00db71dab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:11.699459 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c5f67e56-5fb5-4d12-b3c4-f9d00db71dab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:11.702519 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c5f67e56-5fb5-4d12-b3c4-f9d00db71dab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:11.704529 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c5f67e56-5fb5-4d12-b3c4-f9d00db71dab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:11.870688 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-eadd376f-a53a-45c3-b29a-4987ab1b2b46 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:11.899689 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eadd376f-a53a-45c3-b29a-4987ab1b2b46 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.342608 Jun 24 08:44:11.906229 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 186/385] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:11 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:11.951141 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c5f67e56-5fb5-4d12-b3c4-f9d00db71dab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:11.970948 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c5f67e56-5fb5-4d12-b3c4-f9d00db71dab tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.303541 Jun 24 08:44:11.984162 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 200/386] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:11 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:12.922615 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7b23c730-9430-457d-830e-27d1debb363d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:12.923395 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7b23c730-9430-457d-830e-27d1debb363d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:12.926139 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=46 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:12.932577 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b23c730-9430-457d-830e-27d1debb363d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:12.932577 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b23c730-9430-457d-830e-27d1debb363d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:12.934988 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b23c730-9430-457d-830e-27d1debb363d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:12.935487 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b23c730-9430-457d-830e-27d1debb363d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:13.000907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-af3f98fc-1cf4-4ef8-bf77-9301747221ba tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:13.002145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-af3f98fc-1cf4-4ef8-bf77-9301747221ba tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:13.020093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-af3f98fc-1cf4-4ef8-bf77-9301747221ba tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:13.021834 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-af3f98fc-1cf4-4ef8-bf77-9301747221ba tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:13.022571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-af3f98fc-1cf4-4ef8-bf77-9301747221ba tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:13.025370 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-af3f98fc-1cf4-4ef8-bf77-9301747221ba tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:13.140800 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7b23c730-9430-457d-830e-27d1debb363d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:13.153115 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7b23c730-9430-457d-830e-27d1debb363d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.234353 Jun 24 08:44:13.162484 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 187/387] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:12 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:13.344471 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-af3f98fc-1cf4-4ef8-bf77-9301747221ba tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:13.364356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-af3f98fc-1cf4-4ef8-bf77-9301747221ba tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.368049 Jun 24 08:44:13.367418 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 201/388] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:12 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:13.583134 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-586877ae-0506-4cef-b42f-a6fd487bbcf7 req-dc08256d-8b2d-4548-beab-8f476c6684fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9754407b-6b66-4af9-8f31-452cfbbf19e4", "name": "network-vif-plugged", "status": "completed", "tag": "506af44b-105c-48b6-b580-5fa177c6e0f3"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:13.592048 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-586877ae-0506-4cef-b42f-a6fd487bbcf7 req-dc08256d-8b2d-4548-beab-8f476c6684fa service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:13.592484 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-586877ae-0506-4cef-b42f-a6fd487bbcf7 req-dc08256d-8b2d-4548-beab-8f476c6684fa service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:13.605174 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-586877ae-0506-4cef-b42f-a6fd487bbcf7 req-dc08256d-8b2d-4548-beab-8f476c6684fa service nova] Creating event network-vif-plugged:506af44b-105c-48b6-b580-5fa177c6e0f3 for instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 on hv-cinder-84517 Jun 24 08:44:13.610414 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-586877ae-0506-4cef-b42f-a6fd487bbcf7 req-dc08256d-8b2d-4548-beab-8f476c6684fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031592 Jun 24 08:44:13.611006 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 188/389] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:14.173638 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-df603759-4781-4fd8-b48b-d7c2e6944bdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:14.174157 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-df603759-4781-4fd8-b48b-d7c2e6944bdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:14.180435 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-df603759-4781-4fd8-b48b-d7c2e6944bdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:14.180878 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-df603759-4781-4fd8-b48b-d7c2e6944bdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:14.181762 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-df603759-4781-4fd8-b48b-d7c2e6944bdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:14.182363 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-df603759-4781-4fd8-b48b-d7c2e6944bdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:14.323649 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-df603759-4781-4fd8-b48b-d7c2e6944bdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:14.333708 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-df603759-4781-4fd8-b48b-d7c2e6944bdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.164079 Jun 24 08:44:14.335063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 202/390] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:14 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:14.388229 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-408d7f78-b684-412d-966d-6f378279a81c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:14.389162 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-408d7f78-b684-412d-966d-6f378279a81c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:14.396631 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-408d7f78-b684-412d-966d-6f378279a81c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:14.397095 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-408d7f78-b684-412d-966d-6f378279a81c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:14.397856 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-408d7f78-b684-412d-966d-6f378279a81c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:14.398315 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-408d7f78-b684-412d-966d-6f378279a81c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:14.560146 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-408d7f78-b684-412d-966d-6f378279a81c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:14.571943 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-408d7f78-b684-412d-966d-6f378279a81c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.187554 Jun 24 08:44:14.581773 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 189/391] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:14 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:15.356677 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3e60af2a-685b-47e4-9a9c-ac58e6fc3659 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:15.357301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3e60af2a-685b-47e4-9a9c-ac58e6fc3659 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:15.368362 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3e60af2a-685b-47e4-9a9c-ac58e6fc3659 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.369045 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3e60af2a-685b-47e4-9a9c-ac58e6fc3659 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.369959 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3e60af2a-685b-47e4-9a9c-ac58e6fc3659 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.370384 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3e60af2a-685b-47e4-9a9c-ac58e6fc3659 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.590602 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-68ac012f-82ef-406a-94f1-bad131c8cac4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:15.591334 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-68ac012f-82ef-406a-94f1-bad131c8cac4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:15.602296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68ac012f-82ef-406a-94f1-bad131c8cac4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.604002 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68ac012f-82ef-406a-94f1-bad131c8cac4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.604852 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68ac012f-82ef-406a-94f1-bad131c8cac4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.605299 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3e60af2a-685b-47e4-9a9c-ac58e6fc3659 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:15.605479 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68ac012f-82ef-406a-94f1-bad131c8cac4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.613583 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3e60af2a-685b-47e4-9a9c-ac58e6fc3659 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1501 microversion: 2.1 time: 0.261354 Jun 24 08:44:15.614158 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 203/392] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:15 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1501 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:15.632564 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cbc0a8e4-de98-42fa-a875-7c0626178486 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2af9cc41-544c-4a05-b07d-11606cade84d"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:15.634800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cbc0a8e4-de98-42fa-a875-7c0626178486 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:15.642073 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cbc0a8e4-de98-42fa-a875-7c0626178486 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.642786 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cbc0a8e4-de98-42fa-a875-7c0626178486 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.643830 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cbc0a8e4-de98-42fa-a875-7c0626178486 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.645571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cbc0a8e4-de98-42fa-a875-7c0626178486 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.677523 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-cbc0a8e4-de98-42fa-a875-7c0626178486 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] HTTP exception thrown: Cannot 'attach_volume' instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 while it is in vm_state rescued Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cbc0a8e4-de98-42fa-a875-7c0626178486 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Request method failure captured: Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: POST /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9/os-volume_attachments HTTP/1.1 Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 74 Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXjCaDzQeeAS88pmIEoV75NGz1sj1VFNBYsQJRSIP7bTwhkvZVmMob71ZMhhz0MXKI4QBKEgB9PxOXzRd6Lsfc6ptuzcRWEP10RAhAFSAn27e_oFtPDU9vYOeHa8F7uXDn7JXFYCPp0Sf9ACgzg56ujtHpiUhbgtlC9s0ZP50y_R5v0 Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: edde4704253a4439bd7ca50b26e24e40 Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:44:15.679723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:44:15.681347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_edde4704253a4439bd7ca50b26e24e40", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:44:15.681347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:44:15.681347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: edde4704253a4439bd7ca50b26e24e40 Jun 24 08:44:15.681347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:44:15.681347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-ServerRescueNegativeTestJSON-633414902-project Jun 24 08:44:15.681347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:44:15.681347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:44:15.681347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 9abdce8004e24e81bd88bee757d8ec93 Jun 24 08:44:15.681347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-ServerRescueNegativeTestJSON-633414902-project Jun 24 08:44:15.681347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Jun 24 08:44:15.681347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {"volumeAttachment": {"volumeId": "2af9cc41-544c-4a05-b07d-11606cade84d"}} Jun 24 08:44:15.681347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Cannot 'attach_volume' instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 while it is in vm_state rescued Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'server_id': '6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9', 'body': {'volumeAttachment': {'volumeId': '2af9cc41-544c-4a05-b07d-11606cade84d'}}} Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:44:15.682314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 while it is in vm_state rescued Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:44:15.683779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:44:15.685171 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:44:15.685171 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:44:15.685171 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 while it is in vm_state rescued Jun 24 08:44:15.685171 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:44:15.704131 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cbc0a8e4-de98-42fa-a875-7c0626178486 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Returning 409 to user: Cannot 'attach_volume' instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 while it is in vm_state rescued {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:44:15.706576 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cbc0a8e4-de98-42fa-a875-7c0626178486 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "POST /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.078838 Jun 24 08:44:15.712298 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 204/393] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Jun 24 08:44:15 2022] POST /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9/os-volume_attachments => generated 152 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 24 08:44:15.718949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-62a81778-8f08-4dbd-b7d6-5754fdba5416 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:15.719828 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-62a81778-8f08-4dbd-b7d6-5754fdba5416 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:15.728387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62a81778-8f08-4dbd-b7d6-5754fdba5416 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.729438 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62a81778-8f08-4dbd-b7d6-5754fdba5416 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.730539 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62a81778-8f08-4dbd-b7d6-5754fdba5416 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.731528 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-62a81778-8f08-4dbd-b7d6-5754fdba5416 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.762156 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:15.918024 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-62a81778-8f08-4dbd-b7d6-5754fdba5416 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "POST /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9/action" status: 202 len: 0 microversion: 2.1 time: 0.203391 Jun 24 08:44:15.931992 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 205/394] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Jun 24 08:44:15 2022] POST /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:44:15.950979 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-deff620b-5477-4518-a5ff-5e457177f693 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:15.953357 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-deff620b-5477-4518-a5ff-5e457177f693 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:15.966286 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-68ac012f-82ef-406a-94f1-bad131c8cac4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:15.982010 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-deff620b-5477-4518-a5ff-5e457177f693 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.983150 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-68ac012f-82ef-406a-94f1-bad131c8cac4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.397372 Jun 24 08:44:15.983693 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-deff620b-5477-4518-a5ff-5e457177f693 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.985334 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 190/395] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:15 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:15.989252 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-deff620b-5477-4518-a5ff-5e457177f693 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.992543 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-deff620b-5477-4518-a5ff-5e457177f693 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:16.218593 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-deff620b-5477-4518-a5ff-5e457177f693 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:16.227896 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-deff620b-5477-4518-a5ff-5e457177f693 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1509 microversion: 2.1 time: 0.293552 Jun 24 08:44:16.228686 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 206/396] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:15 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1509 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:17.001874 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9107af88-939e-4ca3-a25d-648e03c55935 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:17.002516 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9107af88-939e-4ca3-a25d-648e03c55935 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:17.011784 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9107af88-939e-4ca3-a25d-648e03c55935 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.013244 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9107af88-939e-4ca3-a25d-648e03c55935 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.016299 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9107af88-939e-4ca3-a25d-648e03c55935 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.016717 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9107af88-939e-4ca3-a25d-648e03c55935 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.178882 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9107af88-939e-4ca3-a25d-648e03c55935 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:17.187001 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9107af88-939e-4ca3-a25d-648e03c55935 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.189021 Jun 24 08:44:17.197298 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 191/397] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:16 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:17.245214 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9794b3bb-ce8d-4c06-835d-1098d289cb06 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:17.245906 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9794b3bb-ce8d-4c06-835d-1098d289cb06 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:17.252515 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9794b3bb-ce8d-4c06-835d-1098d289cb06 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.252968 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9794b3bb-ce8d-4c06-835d-1098d289cb06 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.254281 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9794b3bb-ce8d-4c06-835d-1098d289cb06 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.254732 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9794b3bb-ce8d-4c06-835d-1098d289cb06 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.468227 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9794b3bb-ce8d-4c06-835d-1098d289cb06 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:17.480509 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9794b3bb-ce8d-4c06-835d-1098d289cb06 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1509 microversion: 2.1 time: 0.238542 Jun 24 08:44:17.491374 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 207/398] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:17 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:18.205458 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-743fa311-babc-4284-b5bd-79f67189c72a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:18.208167 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-743fa311-babc-4284-b5bd-79f67189c72a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:18.215694 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-743fa311-babc-4284-b5bd-79f67189c72a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.216134 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-743fa311-babc-4284-b5bd-79f67189c72a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.217238 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-743fa311-babc-4284-b5bd-79f67189c72a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.217668 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-743fa311-babc-4284-b5bd-79f67189c72a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.390178 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-743fa311-babc-4284-b5bd-79f67189c72a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:18.399407 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-743fa311-babc-4284-b5bd-79f67189c72a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.198409 Jun 24 08:44:18.409375 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 192/399] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:18 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:18.504384 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6c9baccc-69e5-44eb-91fe-fd21ae8475e9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:18.505278 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6c9baccc-69e5-44eb-91fe-fd21ae8475e9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:18.513453 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6c9baccc-69e5-44eb-91fe-fd21ae8475e9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.513830 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6c9baccc-69e5-44eb-91fe-fd21ae8475e9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.515097 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6c9baccc-69e5-44eb-91fe-fd21ae8475e9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.515962 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6c9baccc-69e5-44eb-91fe-fd21ae8475e9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.713460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6c9baccc-69e5-44eb-91fe-fd21ae8475e9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:18.723646 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6c9baccc-69e5-44eb-91fe-fd21ae8475e9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1509 microversion: 2.1 time: 0.224030 Jun 24 08:44:18.727276 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 208/400] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:18 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:19.416691 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0253ecdd-d76e-4e05-a489-48333b28ba64 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:19.417353 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0253ecdd-d76e-4e05-a489-48333b28ba64 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:19.424967 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0253ecdd-d76e-4e05-a489-48333b28ba64 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:19.425791 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0253ecdd-d76e-4e05-a489-48333b28ba64 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:19.426858 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0253ecdd-d76e-4e05-a489-48333b28ba64 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:19.428532 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0253ecdd-d76e-4e05-a489-48333b28ba64 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:19.438729 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:19.602157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0253ecdd-d76e-4e05-a489-48333b28ba64 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:19.611674 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0253ecdd-d76e-4e05-a489-48333b28ba64 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.198509 Jun 24 08:44:19.625562 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 193/401] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:19 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:19.741208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ad587af7-dee6-4287-bc29-b93e0dadd80d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:19.742518 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ad587af7-dee6-4287-bc29-b93e0dadd80d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:19.748919 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad587af7-dee6-4287-bc29-b93e0dadd80d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:19.749644 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad587af7-dee6-4287-bc29-b93e0dadd80d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:19.750622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad587af7-dee6-4287-bc29-b93e0dadd80d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:19.751267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad587af7-dee6-4287-bc29-b93e0dadd80d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:19.906443 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ad587af7-dee6-4287-bc29-b93e0dadd80d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:19.916412 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ad587af7-dee6-4287-bc29-b93e0dadd80d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1509 microversion: 2.1 time: 0.179301 Jun 24 08:44:19.926774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 209/402] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:19 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:20.633172 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6f1c984b-48c1-45c5-90fc-128b13ac88aa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:20.633823 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6f1c984b-48c1-45c5-90fc-128b13ac88aa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:20.640231 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f1c984b-48c1-45c5-90fc-128b13ac88aa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:20.640677 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f1c984b-48c1-45c5-90fc-128b13ac88aa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:20.641434 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f1c984b-48c1-45c5-90fc-128b13ac88aa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:20.641869 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f1c984b-48c1-45c5-90fc-128b13ac88aa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:20.770096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6f1c984b-48c1-45c5-90fc-128b13ac88aa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:20.777576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6f1c984b-48c1-45c5-90fc-128b13ac88aa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.148280 Jun 24 08:44:20.778213 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 194/403] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:20 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:20.933892 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1c5d6dd9-dcfb-4777-a356-99bbbca29d8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:20.934480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1c5d6dd9-dcfb-4777-a356-99bbbca29d8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:20.940421 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c5d6dd9-dcfb-4777-a356-99bbbca29d8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:20.940859 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c5d6dd9-dcfb-4777-a356-99bbbca29d8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:20.941603 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c5d6dd9-dcfb-4777-a356-99bbbca29d8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:20.942036 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c5d6dd9-dcfb-4777-a356-99bbbca29d8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:21.074621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1c5d6dd9-dcfb-4777-a356-99bbbca29d8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:21.082502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1c5d6dd9-dcfb-4777-a356-99bbbca29d8e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1509 microversion: 2.1 time: 0.152507 Jun 24 08:44:21.083056 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 210/404] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:20 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:21.795070 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d193585b-0225-40e1-9e34-11c5510316b5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:21.796294 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d193585b-0225-40e1-9e34-11c5510316b5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:21.807285 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d193585b-0225-40e1-9e34-11c5510316b5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:21.808312 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d193585b-0225-40e1-9e34-11c5510316b5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:21.810704 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d193585b-0225-40e1-9e34-11c5510316b5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:21.811917 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d193585b-0225-40e1-9e34-11c5510316b5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:22.100143 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a5186323-51bc-4969-a5ba-b016ed1248a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:22.100851 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a5186323-51bc-4969-a5ba-b016ed1248a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:22.107051 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5186323-51bc-4969-a5ba-b016ed1248a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:22.107522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5186323-51bc-4969-a5ba-b016ed1248a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:22.108284 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5186323-51bc-4969-a5ba-b016ed1248a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:22.108712 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5186323-51bc-4969-a5ba-b016ed1248a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:22.290943 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d193585b-0225-40e1-9e34-11c5510316b5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:22.299039 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d193585b-0225-40e1-9e34-11c5510316b5 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1357 microversion: 2.1 time: 0.508405 Jun 24 08:44:22.308402 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 195/405] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:21 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1357 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:22.312469 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a5186323-51bc-4969-a5ba-b016ed1248a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:22.321199 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a5186323-51bc-4969-a5ba-b016ed1248a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1509 microversion: 2.1 time: 0.224980 Jun 24 08:44:22.321988 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 211/406] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:22 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:23.316325 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f36a1ef4-5d38-40c8-89f6-64471f3afbdf tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:23.316935 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f36a1ef4-5d38-40c8-89f6-64471f3afbdf tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:23.323436 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f36a1ef4-5d38-40c8-89f6-64471f3afbdf tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.323882 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f36a1ef4-5d38-40c8-89f6-64471f3afbdf tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.324639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f36a1ef4-5d38-40c8-89f6-64471f3afbdf tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.325071 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f36a1ef4-5d38-40c8-89f6-64471f3afbdf tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.338280 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b36e2bca-b456-4321-906e-42e607336e84 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:23.339123 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b36e2bca-b456-4321-906e-42e607336e84 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:23.345217 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b36e2bca-b456-4321-906e-42e607336e84 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.345774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b36e2bca-b456-4321-906e-42e607336e84 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.346948 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b36e2bca-b456-4321-906e-42e607336e84 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.347481 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b36e2bca-b456-4321-906e-42e607336e84 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.510104 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f36a1ef4-5d38-40c8-89f6-64471f3afbdf tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:23.518044 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f36a1ef4-5d38-40c8-89f6-64471f3afbdf tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1547 microversion: 2.1 time: 0.206041 Jun 24 08:44:23.519435 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 196/407] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:23 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1547 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:23.536246 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9edd05b3-f6ce-4f4d-920c-3c3fdbef3961 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:23.537169 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9edd05b3-f6ce-4f4d-920c-3c3fdbef3961 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:23.540651 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b36e2bca-b456-4321-906e-42e607336e84 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:23.545354 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9edd05b3-f6ce-4f4d-920c-3c3fdbef3961 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.545904 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9edd05b3-f6ce-4f4d-920c-3c3fdbef3961 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.546779 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9edd05b3-f6ce-4f4d-920c-3c3fdbef3961 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.547352 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9edd05b3-f6ce-4f4d-920c-3c3fdbef3961 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.548746 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b36e2bca-b456-4321-906e-42e607336e84 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1509 microversion: 2.1 time: 0.214280 Jun 24 08:44:23.549312 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 212/408] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:23 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1509 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:23.698364 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9edd05b3-f6ce-4f4d-920c-3c3fdbef3961 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:23.708013 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9edd05b3-f6ce-4f4d-920c-3c3fdbef3961 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1547 microversion: 2.1 time: 0.176419 Jun 24 08:44:23.708918 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 197/409] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:23 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1547 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:23.723937 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-765e5ca2-39ca-4445-ae42-e62ac7e2298a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:23.727419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-765e5ca2-39ca-4445-ae42-e62ac7e2298a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:23.728182 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-765e5ca2-39ca-4445-ae42-e62ac7e2298a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Searching by: {'deleted': False, 'project_id': 'a862170421a346088ab15bc89c9a5716'} {{(pid=124379) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 24 08:44:23.735867 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-765e5ca2-39ca-4445-ae42-e62ac7e2298a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.736304 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-765e5ca2-39ca-4445-ae42-e62ac7e2298a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.737112 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-765e5ca2-39ca-4445-ae42-e62ac7e2298a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.737538 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-765e5ca2-39ca-4445-ae42-e62ac7e2298a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.825917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.multi_cell_list [None req-765e5ca2-39ca-4445-ae42-e62ac7e2298a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124379) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 24 08:44:23.917300 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-765e5ca2-39ca-4445-ae42-e62ac7e2298a tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.197105 Jun 24 08:44:23.918415 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 213/410] 10.222.0.43 () {58 vars in 1124 bytes} [Fri Jun 24 08:44:23 2022] GET /compute/v2.1/servers => generated 341 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:23.930289 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7944ba24-3671-4497-9b75-7c8142794bf3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:23.930876 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7944ba24-3671-4497-9b75-7c8142794bf3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:23.937390 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7944ba24-3671-4497-9b75-7c8142794bf3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.937936 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7944ba24-3671-4497-9b75-7c8142794bf3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.938982 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7944ba24-3671-4497-9b75-7c8142794bf3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.939373 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7944ba24-3671-4497-9b75-7c8142794bf3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:24.073744 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7944ba24-3671-4497-9b75-7c8142794bf3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:24.081603 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7944ba24-3671-4497-9b75-7c8142794bf3 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1547 microversion: 2.1 time: 0.155135 Jun 24 08:44:24.082220 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 198/411] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:23 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:24.565181 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b3f93491-51ba-45d4-a304-1ab2e2b329a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:24.565801 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b3f93491-51ba-45d4-a304-1ab2e2b329a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:24.571797 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3f93491-51ba-45d4-a304-1ab2e2b329a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:24.572249 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3f93491-51ba-45d4-a304-1ab2e2b329a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:24.573003 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3f93491-51ba-45d4-a304-1ab2e2b329a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:24.573619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3f93491-51ba-45d4-a304-1ab2e2b329a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:24.727644 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b3f93491-51ba-45d4-a304-1ab2e2b329a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:24.736146 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b3f93491-51ba-45d4-a304-1ab2e2b329a2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1509 microversion: 2.1 time: 0.174862 Jun 24 08:44:24.743545 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 214/412] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:24 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:25.622942 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-611c2b08-41f1-4564-8441-0255f11a1e60 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b3d3610-bce1-4199-897b-6b53f99f6845"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:25.624109 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-611c2b08-41f1-4564-8441-0255f11a1e60 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:25.630613 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-611c2b08-41f1-4564-8441-0255f11a1e60 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:25.631006 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-611c2b08-41f1-4564-8441-0255f11a1e60 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:25.631902 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-611c2b08-41f1-4564-8441-0255f11a1e60 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:25.632334 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-611c2b08-41f1-4564-8441-0255f11a1e60 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:25.754437 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0ee0d69a-e505-48ad-bdaa-6d685634a5e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:25.755040 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0ee0d69a-e505-48ad-bdaa-6d685634a5e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:25.757012 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=56 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:25.761904 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0ee0d69a-e505-48ad-bdaa-6d685634a5e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:25.762347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0ee0d69a-e505-48ad-bdaa-6d685634a5e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:25.763112 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0ee0d69a-e505-48ad-bdaa-6d685634a5e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:25.763560 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0ee0d69a-e505-48ad-bdaa-6d685634a5e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:25.929287 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0ee0d69a-e505-48ad-bdaa-6d685634a5e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:25.942940 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0ee0d69a-e505-48ad-bdaa-6d685634a5e8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1509 microversion: 2.1 time: 0.192923 Jun 24 08:44:25.943538 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 215/413] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:25 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1509 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:25.973268 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-611c2b08-41f1-4564-8441-0255f11a1e60 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "POST /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354057 Jun 24 08:44:25.974160 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 199/414] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Jun 24 08:44:25 2022] POST /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:26.964253 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-35732913-ed55-429c-b850-f635b56ac24e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:26.965847 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-35732913-ed55-429c-b850-f635b56ac24e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:26.983168 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-35732913-ed55-429c-b850-f635b56ac24e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:26.983950 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-35732913-ed55-429c-b850-f635b56ac24e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:26.984938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-35732913-ed55-429c-b850-f635b56ac24e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:26.987392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-35732913-ed55-429c-b850-f635b56ac24e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:27.276691 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-35732913-ed55-429c-b850-f635b56ac24e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:27.287090 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-35732913-ed55-429c-b850-f635b56ac24e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1515 microversion: 2.1 time: 0.326698 Jun 24 08:44:27.288768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 216/415] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:26 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1515 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:29.999775 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-49b18edd-500b-40f3-b4e7-72ceb9886f88 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Action: 'create', calling method: .version_select at 0x7fb75cbd6f70>, body: {"keypair": {"name": "tempest-keypair-39015232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt8hhiK68tkH/RYEUnuus11B6+XQ7KneEYPR1gRI97WY0ZPvwTSu8cVe8vd8KhYOnAr/v275sWSn2uYc5tU0OZqruhTw8Ue9xmrMrSrH+xAFlZvNlBNOZgrfPS2DCNmnA=="}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:30.040443 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-49b18edd-500b-40f3-b4e7-72ceb9886f88 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Getting quotas for project edde4704253a4439bd7ca50b26e24e40. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:44:30.051858 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-49b18edd-500b-40f3-b4e7-72ceb9886f88 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Getting quotas for user 9abdce8004e24e81bd88bee757d8ec93 and project edde4704253a4439bd7ca50b26e24e40. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:44:30.097850 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-49b18edd-500b-40f3-b4e7-72ceb9886f88 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.102554 Jun 24 08:44:30.100420 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 200/416] 10.222.0.43 () {60 vars in 1158 bytes} [Fri Jun 24 08:44:29 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:32.562075 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-490064693", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d3ac0d05-2596-446f-acfb-1d270fd8725c"}], "security_groups": [{"name": "tempest-securitygroup--1928499726"}], "key_name": "tempest-keypair-39015232", "user_data": "}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:32.738237 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] validate_networks() for [('d3ac0d05-2596-446f-acfb-1d270fd8725c', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:44:33.364833 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:44:33.365663 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:44:33.366198 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:44:33.366814 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:44:33.367249 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:44:33.390034 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:33.390483 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:33.391321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:33.391967 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:33.418368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Getting quotas for project edde4704253a4439bd7ca50b26e24e40. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:44:33.423156 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Getting quotas for user 9abdce8004e24e81bd88bee757d8ec93 and project edde4704253a4439bd7ca50b26e24e40. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:44:33.439903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:44:33.443624 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:44:33.499220 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b49b6475-327f-46f5-8597-3276797f415a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.943315 Jun 24 08:44:33.500474 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 217/417] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:44:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:44:33.511050 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-25faf007-5967-4e86-95ff-ec0df4283a1c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:33.511819 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-25faf007-5967-4e86-95ff-ec0df4283a1c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:33.593659 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-25faf007-5967-4e86-95ff-ec0df4283a1c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:33.602429 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-25faf007-5967-4e86-95ff-ec0df4283a1c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1243 microversion: 2.1 time: 0.095607 Jun 24 08:44:33.602991 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 201/418] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:33 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1243 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:34.621002 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bcf80fc1-d5d0-4b02-8461-cfcd84b25720 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:34.622528 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bcf80fc1-d5d0-4b02-8461-cfcd84b25720 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:34.644779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bcf80fc1-d5d0-4b02-8461-cfcd84b25720 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:34.645607 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bcf80fc1-d5d0-4b02-8461-cfcd84b25720 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:34.646591 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bcf80fc1-d5d0-4b02-8461-cfcd84b25720 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:34.647516 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bcf80fc1-d5d0-4b02-8461-cfcd84b25720 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:34.754141 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bcf80fc1-d5d0-4b02-8461-cfcd84b25720 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:34.763985 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bcf80fc1-d5d0-4b02-8461-cfcd84b25720 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1295 microversion: 2.1 time: 0.147659 Jun 24 08:44:34.765087 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 218/419] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:34 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1295 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:35.265006 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3c59b6fe-e68a-4662-b3ce-b0ac9a4feadb tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:35.265954 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3c59b6fe-e68a-4662-b3ce-b0ac9a4feadb tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:35.294260 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c59b6fe-e68a-4662-b3ce-b0ac9a4feadb tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:35.295560 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c59b6fe-e68a-4662-b3ce-b0ac9a4feadb tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:35.299718 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c59b6fe-e68a-4662-b3ce-b0ac9a4feadb tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:35.304762 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c59b6fe-e68a-4662-b3ce-b0ac9a4feadb tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:35.658456 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3c59b6fe-e68a-4662-b3ce-b0ac9a4feadb tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:35.669231 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3c59b6fe-e68a-4662-b3ce-b0ac9a4feadb tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1593 microversion: 2.1 time: 0.411519 Jun 24 08:44:35.669979 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 202/420] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:35 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1593 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:35.787585 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3514bb06-2eaf-476b-84a6-06baa4c111b8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:35.788850 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3514bb06-2eaf-476b-84a6-06baa4c111b8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:35.806620 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3514bb06-2eaf-476b-84a6-06baa4c111b8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:35.807367 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3514bb06-2eaf-476b-84a6-06baa4c111b8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:35.809349 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3514bb06-2eaf-476b-84a6-06baa4c111b8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:35.810989 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3514bb06-2eaf-476b-84a6-06baa4c111b8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:36.010045 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3514bb06-2eaf-476b-84a6-06baa4c111b8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:36.024783 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3514bb06-2eaf-476b-84a6-06baa4c111b8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1301 microversion: 2.1 time: 0.245375 Jun 24 08:44:36.042488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 219/421] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:35 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1301 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:36.060576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-894438459", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1763929295", "security_groups": [{"name": "tempest-secgroup-smoke-767022495"}], "networks": [{"uuid": "dffd2ce1-462e-4828-aae5-3b548fceac40"}], "block_device_mapping_v2": [{"uuid": "d9ff328e-e2d5-433d-91b1-734e22cb8819", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:36.415230 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] validate_networks() for [('dffd2ce1-462e-4828-aae5-3b548fceac40', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:44:37.049609 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1da25c42-ba35-4c66-bebd-3d02d8598282 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:37.051711 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1da25c42-ba35-4c66-bebd-3d02d8598282 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:37.062811 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1da25c42-ba35-4c66-bebd-3d02d8598282 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:37.066476 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1da25c42-ba35-4c66-bebd-3d02d8598282 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:37.068153 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1da25c42-ba35-4c66-bebd-3d02d8598282 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:37.070813 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1da25c42-ba35-4c66-bebd-3d02d8598282 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:37.241194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1da25c42-ba35-4c66-bebd-3d02d8598282 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:37.256530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1da25c42-ba35-4c66-bebd-3d02d8598282 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1301 microversion: 2.1 time: 0.210853 Jun 24 08:44:37.266065 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 220/422] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:37 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1301 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:37.704921 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:44:37.706633 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:44:37.707384 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:44:37.708240 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:44:37.708863 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:44:37.727175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:37.727696 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:37.728507 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:37.728947 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:37.760461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Getting quotas for project d567a9e7ba344ca4ac65b276b57995d1. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:44:37.766676 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Getting quotas for user 7eb223c95f794ebd8d34f3a8627dfd89 and project d567a9e7ba344ca4ac65b276b57995d1. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:44:37.873730 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:44:37.876019 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d9ff328e-e2d5-433d-91b1-734e22cb8819',volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:44:38.154053 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3bb54a7a-beb3-4fa6-985b-d09e56be2ced tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.097419 Jun 24 08:44:38.165827 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-551e4494-b7d3-42c4-ae48-7ada3688ceb2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:38.167142 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-551e4494-b7d3-42c4-ae48-7ada3688ceb2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:38.170929 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 203/423] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:44:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 2105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:44:38.262901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-551e4494-b7d3-42c4-ae48-7ada3688ceb2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:38.274595 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d2ed73dd-6184-458c-a7da-fbc43d8303ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:38.275575 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d2ed73dd-6184-458c-a7da-fbc43d8303ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:38.279736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-551e4494-b7d3-42c4-ae48-7ada3688ceb2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1088 microversion: 2.1 time: 0.117731 Jun 24 08:44:38.288864 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d2ed73dd-6184-458c-a7da-fbc43d8303ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:38.290081 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d2ed73dd-6184-458c-a7da-fbc43d8303ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:38.291361 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 221/424] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:38 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1088 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:38.291537 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d2ed73dd-6184-458c-a7da-fbc43d8303ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:38.291973 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d2ed73dd-6184-458c-a7da-fbc43d8303ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:38.620065 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d2ed73dd-6184-458c-a7da-fbc43d8303ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:38.641532 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d2ed73dd-6184-458c-a7da-fbc43d8303ff tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.371212 Jun 24 08:44:38.650668 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 204/425] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:38 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:39.299431 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3231fa91-a4af-4f9a-b03b-51c1d55d5cfb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:39.304792 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3231fa91-a4af-4f9a-b03b-51c1d55d5cfb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:39.311870 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3231fa91-a4af-4f9a-b03b-51c1d55d5cfb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:39.312513 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3231fa91-a4af-4f9a-b03b-51c1d55d5cfb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:39.313440 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3231fa91-a4af-4f9a-b03b-51c1d55d5cfb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:39.314023 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3231fa91-a4af-4f9a-b03b-51c1d55d5cfb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:39.327369 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:39.417933 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3231fa91-a4af-4f9a-b03b-51c1d55d5cfb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:39.431247 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3231fa91-a4af-4f9a-b03b-51c1d55d5cfb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1138 microversion: 2.1 time: 0.135540 Jun 24 08:44:39.443047 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 222/426] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:39 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1138 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:39.664014 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bd3771bd-2a26-43df-806a-4e64ef2b0052 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:39.665428 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bd3771bd-2a26-43df-806a-4e64ef2b0052 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:39.677974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bd3771bd-2a26-43df-806a-4e64ef2b0052 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:39.678596 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bd3771bd-2a26-43df-806a-4e64ef2b0052 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:39.679546 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bd3771bd-2a26-43df-806a-4e64ef2b0052 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:39.680123 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bd3771bd-2a26-43df-806a-4e64ef2b0052 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:39.716876 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-93eea45a-65b9-47b2-90eb-1dcf5de24a70 req-5932a19c-6e57-402a-aecc-1abcfe49104f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9754407b-6b66-4af9-8f31-452cfbbf19e4", "tag": "506af44b-105c-48b6-b580-5fa177c6e0f3"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:39.731510 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-93eea45a-65b9-47b2-90eb-1dcf5de24a70 req-5932a19c-6e57-402a-aecc-1abcfe49104f service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:39.732130 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-93eea45a-65b9-47b2-90eb-1dcf5de24a70 req-5932a19c-6e57-402a-aecc-1abcfe49104f service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:39.745142 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-93eea45a-65b9-47b2-90eb-1dcf5de24a70 req-5932a19c-6e57-402a-aecc-1abcfe49104f service nova] Creating event network-changed:506af44b-105c-48b6-b580-5fa177c6e0f3 for instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 on hv-cinder-84517 Jun 24 08:44:39.753554 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-93eea45a-65b9-47b2-90eb-1dcf5de24a70 req-5932a19c-6e57-402a-aecc-1abcfe49104f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041560 Jun 24 08:44:39.754511 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 223/427] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:44:39.879326 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bd3771bd-2a26-43df-806a-4e64ef2b0052 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:39.890737 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bd3771bd-2a26-43df-806a-4e64ef2b0052 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.232328 Jun 24 08:44:39.891751 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 205/428] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:39 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:40.052987 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-019ee57d-e198-4ce2-b72d-43c5dae0ffe4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Action: 'create', calling method: .version_select at 0x7fb75d2b7430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1167158324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7d5b7IT+84ofZYuP/awd6sv493xaMe29kgufw1ERmn3zB9w0ov/FE38HS4qvv1UGeHA+YR+lLO1QrTg88am2Etm/0DKlcVbMWykyjcyThi22hE363rHOXaL/KN53y9oA=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:40.134892 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-019ee57d-e198-4ce2-b72d-43c5dae0ffe4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Getting quotas for project 891980c3542d4223a15461bb7c5dcff9. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:44:40.145564 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-019ee57d-e198-4ce2-b72d-43c5dae0ffe4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Getting quotas for user 7f65bea891fb461086d6a60177ff2d65 and project 891980c3542d4223a15461bb7c5dcff9. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:44:40.195621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-019ee57d-e198-4ce2-b72d-43c5dae0ffe4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.439651 Jun 24 08:44:40.197387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 224/429] 10.222.0.43 () {60 vars in 1158 bytes} [Fri Jun 24 08:44:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:40.450538 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1747ad0e-d12f-4214-a294-c1cd1dc8e58e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:40.451400 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1747ad0e-d12f-4214-a294-c1cd1dc8e58e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:40.471258 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1747ad0e-d12f-4214-a294-c1cd1dc8e58e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:40.472350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1747ad0e-d12f-4214-a294-c1cd1dc8e58e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:40.473781 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1747ad0e-d12f-4214-a294-c1cd1dc8e58e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:40.474225 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1747ad0e-d12f-4214-a294-c1cd1dc8e58e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:40.617421 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1747ad0e-d12f-4214-a294-c1cd1dc8e58e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:40.632973 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1747ad0e-d12f-4214-a294-c1cd1dc8e58e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1130 microversion: 2.1 time: 0.186596 Jun 24 08:44:40.636646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 206/430] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:40 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1130 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:40.921171 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5e5f1a02-e83d-4b64-a229-ff7ad3402d96 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:40.923476 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5e5f1a02-e83d-4b64-a229-ff7ad3402d96 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:40.993680 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5e5f1a02-e83d-4b64-a229-ff7ad3402d96 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:40.996297 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5e5f1a02-e83d-4b64-a229-ff7ad3402d96 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:41.005480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5e5f1a02-e83d-4b64-a229-ff7ad3402d96 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:41.006959 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5e5f1a02-e83d-4b64-a229-ff7ad3402d96 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:41.481966 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5e5f1a02-e83d-4b64-a229-ff7ad3402d96 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:41.495106 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-87a215f5-5adb-4b68-b593-353c527180b5 req-f984fd07-39ce-437c-a41f-5c5db22f7694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d9a15b4-2e8f-47c3-88f1-95b5c4755c92", "tag": "2a1e43f9-7be3-4e9c-9137-a737077baa15"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:41.504863 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5e5f1a02-e83d-4b64-a229-ff7ad3402d96 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.599134 Jun 24 08:44:41.508522 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-87a215f5-5adb-4b68-b593-353c527180b5 req-f984fd07-39ce-437c-a41f-5c5db22f7694 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:41.508824 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 225/431] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:40 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:41.509640 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-87a215f5-5adb-4b68-b593-353c527180b5 req-f984fd07-39ce-437c-a41f-5c5db22f7694 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:41.523695 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-87a215f5-5adb-4b68-b593-353c527180b5 req-f984fd07-39ce-437c-a41f-5c5db22f7694 service nova] Creating event network-changed:2a1e43f9-7be3-4e9c-9137-a737077baa15 for instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 on hv-cinder-84517 Jun 24 08:44:41.529875 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-87a215f5-5adb-4b68-b593-353c527180b5 req-f984fd07-39ce-437c-a41f-5c5db22f7694 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039440 Jun 24 08:44:41.531125 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 207/432] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:44:41.655715 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9e119213-9711-4778-8560-950e6582e875 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:41.656682 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9e119213-9711-4778-8560-950e6582e875 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:41.664870 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e119213-9711-4778-8560-950e6582e875 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:41.665843 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e119213-9711-4778-8560-950e6582e875 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:41.667297 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e119213-9711-4778-8560-950e6582e875 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:41.677149 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e119213-9711-4778-8560-950e6582e875 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:41.805544 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9e119213-9711-4778-8560-950e6582e875 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:41.814934 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9e119213-9711-4778-8560-950e6582e875 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1186 microversion: 2.1 time: 0.163198 Jun 24 08:44:41.828499 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 226/433] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:41 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1186 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:42.150677 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8bbc214e-607d-4285-8119-11d99e3af9b4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-654999305"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:42.151344 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8bbc214e-607d-4285-8119-11d99e3af9b4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:42.158070 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8bbc214e-607d-4285-8119-11d99e3af9b4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.158514 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8bbc214e-607d-4285-8119-11d99e3af9b4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:42.159339 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8bbc214e-607d-4285-8119-11d99e3af9b4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.159772 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8bbc214e-607d-4285-8119-11d99e3af9b4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:42.296137 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.network.security_group_api [None req-8bbc214e-607d-4285-8119-11d99e3af9b4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Adding security group 6ae25cf7-4fbe-4ecf-9d92-d13c25cc058e to port 506af44b-105c-48b6-b580-5fa177c6e0f3 Jun 24 08:44:42.525489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-84eb0e98-a832-4023-b7d0-895c94269d31 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:42.526158 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-84eb0e98-a832-4023-b7d0-895c94269d31 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:42.532642 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84eb0e98-a832-4023-b7d0-895c94269d31 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.533089 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84eb0e98-a832-4023-b7d0-895c94269d31 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:42.533844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84eb0e98-a832-4023-b7d0-895c94269d31 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.534950 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84eb0e98-a832-4023-b7d0-895c94269d31 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:42.765102 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-84eb0e98-a832-4023-b7d0-895c94269d31 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:42.777957 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8bbc214e-607d-4285-8119-11d99e3af9b4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "POST /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/action" status: 202 len: 0 microversion: 2.1 time: 0.632056 Jun 24 08:44:42.779415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 208/434] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Jun 24 08:44:42 2022] POST /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:44:42.779534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-84eb0e98-a832-4023-b7d0-895c94269d31 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.257540 Jun 24 08:44:42.788130 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-10ba643c-153a-4d03-9b96-bbc080282cc8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:42.788758 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-10ba643c-153a-4d03-9b96-bbc080282cc8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:42.790991 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 227/435] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:42 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:42.797225 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-c077832a-ce4d-4576-8903-a3ddb3da6235 req-a9ddba7b-94c2-4f2c-839e-35e8732845c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9754407b-6b66-4af9-8f31-452cfbbf19e4", "tag": "506af44b-105c-48b6-b580-5fa177c6e0f3"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:42.800190 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10ba643c-153a-4d03-9b96-bbc080282cc8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.802870 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10ba643c-153a-4d03-9b96-bbc080282cc8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:42.804921 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10ba643c-153a-4d03-9b96-bbc080282cc8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.806676 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-10ba643c-153a-4d03-9b96-bbc080282cc8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:42.819119 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-c077832a-ce4d-4576-8903-a3ddb3da6235 req-a9ddba7b-94c2-4f2c-839e-35e8732845c0 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.819119 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-c077832a-ce4d-4576-8903-a3ddb3da6235 req-a9ddba7b-94c2-4f2c-839e-35e8732845c0 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:42.835630 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-c077832a-ce4d-4576-8903-a3ddb3da6235 req-a9ddba7b-94c2-4f2c-839e-35e8732845c0 service nova] Creating event network-changed:506af44b-105c-48b6-b580-5fa177c6e0f3 for instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 on hv-cinder-84517 Jun 24 08:44:42.841175 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-c077832a-ce4d-4576-8903-a3ddb3da6235 req-a9ddba7b-94c2-4f2c-839e-35e8732845c0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048852 Jun 24 08:44:42.841776 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 228/436] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:42.847175 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-75000df9-8869-4c59-b42d-7ee07025f355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:42.848057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-75000df9-8869-4c59-b42d-7ee07025f355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:42.857194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-75000df9-8869-4c59-b42d-7ee07025f355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.857639 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-75000df9-8869-4c59-b42d-7ee07025f355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:42.858408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-75000df9-8869-4c59-b42d-7ee07025f355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.858834 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-75000df9-8869-4c59-b42d-7ee07025f355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:42.952210 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-75000df9-8869-4c59-b42d-7ee07025f355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:42.961032 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-75000df9-8869-4c59-b42d-7ee07025f355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1186 microversion: 2.1 time: 0.117586 Jun 24 08:44:42.970744 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 229/437] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:42 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1186 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:43.006484 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-10ba643c-153a-4d03-9b96-bbc080282cc8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:43.015188 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-10ba643c-153a-4d03-9b96-bbc080282cc8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1639 microversion: 2.1 time: 0.231652 Jun 24 08:44:43.015869 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 209/438] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:42 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1639 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:43.796950 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-59e635e4-7853-443c-8249-7dff03df89ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:43.797553 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-59e635e4-7853-443c-8249-7dff03df89ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:43.799552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:43.805213 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59e635e4-7853-443c-8249-7dff03df89ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:43.805655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59e635e4-7853-443c-8249-7dff03df89ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:43.806413 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59e635e4-7853-443c-8249-7dff03df89ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:43.806841 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59e635e4-7853-443c-8249-7dff03df89ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:43.941318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-59e635e4-7853-443c-8249-7dff03df89ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:43.948781 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-59e635e4-7853-443c-8249-7dff03df89ea tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.155921 Jun 24 08:44:43.949330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 230/439] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:43 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:43.977948 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-792a2552-6603-4f1f-9369-2128d831bea3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:43.978548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-792a2552-6603-4f1f-9369-2128d831bea3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:43.981038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:43.986687 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-792a2552-6603-4f1f-9369-2128d831bea3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:43.987138 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-792a2552-6603-4f1f-9369-2128d831bea3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:43.987943 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-792a2552-6603-4f1f-9369-2128d831bea3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:43.988381 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-792a2552-6603-4f1f-9369-2128d831bea3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:44.051205 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-792a2552-6603-4f1f-9369-2128d831bea3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:44.058809 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-792a2552-6603-4f1f-9369-2128d831bea3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1194 microversion: 2.1 time: 0.084805 Jun 24 08:44:44.059393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 210/440] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:43 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:44.966763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-659806f8-ac7a-49dc-8567-92f9c98e2132 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:44.967422 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-659806f8-ac7a-49dc-8567-92f9c98e2132 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:44.973929 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-659806f8-ac7a-49dc-8567-92f9c98e2132 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:44.974372 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-659806f8-ac7a-49dc-8567-92f9c98e2132 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:44.975138 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-659806f8-ac7a-49dc-8567-92f9c98e2132 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:44.975595 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-659806f8-ac7a-49dc-8567-92f9c98e2132 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:45.076171 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0b0c40c3-8a55-4d36-b0ba-896e9d348a17 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:45.076793 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0b0c40c3-8a55-4d36-b0ba-896e9d348a17 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:45.088972 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0b0c40c3-8a55-4d36-b0ba-896e9d348a17 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:45.089685 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0b0c40c3-8a55-4d36-b0ba-896e9d348a17 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:45.090818 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0b0c40c3-8a55-4d36-b0ba-896e9d348a17 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:45.091582 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0b0c40c3-8a55-4d36-b0ba-896e9d348a17 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:45.146174 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-659806f8-ac7a-49dc-8567-92f9c98e2132 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:45.162496 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-659806f8-ac7a-49dc-8567-92f9c98e2132 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.195331 Jun 24 08:44:45.163774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 231/441] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:44 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:45.200165 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0b0c40c3-8a55-4d36-b0ba-896e9d348a17 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:45.211679 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0b0c40c3-8a55-4d36-b0ba-896e9d348a17 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1194 microversion: 2.1 time: 0.137190 Jun 24 08:44:45.212156 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 211/442] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:45 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1194 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:46.184606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7d9e398a-c6b1-44ce-9545-61d99608e387 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:46.185228 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7d9e398a-c6b1-44ce-9545-61d99608e387 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:46.192419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d9e398a-c6b1-44ce-9545-61d99608e387 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:46.193415 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d9e398a-c6b1-44ce-9545-61d99608e387 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:46.194494 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d9e398a-c6b1-44ce-9545-61d99608e387 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:46.195154 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7d9e398a-c6b1-44ce-9545-61d99608e387 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:46.236721 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-27965b50-e18e-4969-8d04-803d03a13a09 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:46.238190 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-27965b50-e18e-4969-8d04-803d03a13a09 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:46.252000 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27965b50-e18e-4969-8d04-803d03a13a09 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:46.256497 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27965b50-e18e-4969-8d04-803d03a13a09 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:46.259253 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27965b50-e18e-4969-8d04-803d03a13a09 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:46.259951 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-27965b50-e18e-4969-8d04-803d03a13a09 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:46.269856 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:46.618572 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-27965b50-e18e-4969-8d04-803d03a13a09 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:46.628907 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-27965b50-e18e-4969-8d04-803d03a13a09 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1204 microversion: 2.1 time: 0.404483 Jun 24 08:44:46.636069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 212/443] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:46 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1204 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:46.702457 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7d9e398a-c6b1-44ce-9545-61d99608e387 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:46.711573 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7d9e398a-c6b1-44ce-9545-61d99608e387 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.535331 Jun 24 08:44:46.714314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 232/444] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:46 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:47.646634 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-02a4fd45-9ee4-4cca-8502-2ecfe023ba91 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:47.647278 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-02a4fd45-9ee4-4cca-8502-2ecfe023ba91 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:47.653683 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02a4fd45-9ee4-4cca-8502-2ecfe023ba91 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:47.654133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02a4fd45-9ee4-4cca-8502-2ecfe023ba91 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:47.654891 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02a4fd45-9ee4-4cca-8502-2ecfe023ba91 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:47.655357 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-02a4fd45-9ee4-4cca-8502-2ecfe023ba91 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:47.728473 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7cf33390-9369-4a14-ba69-20e3dba53017 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:47.729108 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7cf33390-9369-4a14-ba69-20e3dba53017 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:47.735166 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7cf33390-9369-4a14-ba69-20e3dba53017 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:47.735998 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7cf33390-9369-4a14-ba69-20e3dba53017 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:47.736434 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7cf33390-9369-4a14-ba69-20e3dba53017 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:47.736861 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7cf33390-9369-4a14-ba69-20e3dba53017 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:47.749593 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:47.777772 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=12 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:47.819617 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-02a4fd45-9ee4-4cca-8502-2ecfe023ba91 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:47.827398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-02a4fd45-9ee4-4cca-8502-2ecfe023ba91 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.185114 Jun 24 08:44:47.828303 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 213/445] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:47 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:47.885592 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7cf33390-9369-4a14-ba69-20e3dba53017 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:47.893089 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7cf33390-9369-4a14-ba69-20e3dba53017 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.168532 Jun 24 08:44:47.894293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 233/446] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:47 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:48.844707 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3ac6d013-5711-4291-8c99-f50a12a36c8a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:48.845364 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3ac6d013-5711-4291-8c99-f50a12a36c8a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:48.852744 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ac6d013-5711-4291-8c99-f50a12a36c8a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:48.853198 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ac6d013-5711-4291-8c99-f50a12a36c8a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:48.853981 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ac6d013-5711-4291-8c99-f50a12a36c8a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:48.854417 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ac6d013-5711-4291-8c99-f50a12a36c8a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:48.910539 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-afb0a7b4-9536-4fe2-b398-6def2c5dcb2e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:48.911081 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-afb0a7b4-9536-4fe2-b398-6def2c5dcb2e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:48.917354 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-afb0a7b4-9536-4fe2-b398-6def2c5dcb2e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:48.917807 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-afb0a7b4-9536-4fe2-b398-6def2c5dcb2e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:48.918839 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-afb0a7b4-9536-4fe2-b398-6def2c5dcb2e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:48.919318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-afb0a7b4-9536-4fe2-b398-6def2c5dcb2e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:49.024882 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3ac6d013-5711-4291-8c99-f50a12a36c8a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:49.032404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3ac6d013-5711-4291-8c99-f50a12a36c8a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.191533 Jun 24 08:44:49.032966 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 214/447] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:48 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:49.070176 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-afb0a7b4-9536-4fe2-b398-6def2c5dcb2e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:49.078019 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-afb0a7b4-9536-4fe2-b398-6def2c5dcb2e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.172081 Jun 24 08:44:49.078655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 234/448] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:48 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:50.049741 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bdc604ba-60fe-4b85-930c-21120c70b5d6 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:50.050403 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bdc604ba-60fe-4b85-930c-21120c70b5d6 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:50.056852 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bdc604ba-60fe-4b85-930c-21120c70b5d6 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:50.057298 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bdc604ba-60fe-4b85-930c-21120c70b5d6 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:50.058054 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bdc604ba-60fe-4b85-930c-21120c70b5d6 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:50.058489 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bdc604ba-60fe-4b85-930c-21120c70b5d6 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:50.095598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9af5617a-2a77-420c-b620-c1014af348bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:50.096240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9af5617a-2a77-420c-b620-c1014af348bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:50.102346 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9af5617a-2a77-420c-b620-c1014af348bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:50.102798 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9af5617a-2a77-420c-b620-c1014af348bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:50.103586 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9af5617a-2a77-420c-b620-c1014af348bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:50.104026 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9af5617a-2a77-420c-b620-c1014af348bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:50.158899 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=12 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:50.248355 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bdc604ba-60fe-4b85-930c-21120c70b5d6 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:50.256029 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bdc604ba-60fe-4b85-930c-21120c70b5d6 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.210064 Jun 24 08:44:50.256603 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 215/449] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:50 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:50.276288 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9af5617a-2a77-420c-b620-c1014af348bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:50.283837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9af5617a-2a77-420c-b620-c1014af348bd tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.192015 Jun 24 08:44:50.284919 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 235/450] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:50 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:51.271943 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-11214bac-42ec-4891-9008-49b1a8ea0a97 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:51.272551 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-11214bac-42ec-4891-9008-49b1a8ea0a97 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:51.278957 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11214bac-42ec-4891-9008-49b1a8ea0a97 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:51.279434 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11214bac-42ec-4891-9008-49b1a8ea0a97 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:51.280184 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11214bac-42ec-4891-9008-49b1a8ea0a97 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:51.280614 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11214bac-42ec-4891-9008-49b1a8ea0a97 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:51.301559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ad41cb2e-aa23-4241-935e-b9789a7082f9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:51.302170 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ad41cb2e-aa23-4241-935e-b9789a7082f9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:51.308190 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad41cb2e-aa23-4241-935e-b9789a7082f9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:51.308639 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad41cb2e-aa23-4241-935e-b9789a7082f9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:51.309396 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad41cb2e-aa23-4241-935e-b9789a7082f9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:51.309828 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ad41cb2e-aa23-4241-935e-b9789a7082f9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:51.462420 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-11214bac-42ec-4891-9008-49b1a8ea0a97 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:51.469688 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-11214bac-42ec-4891-9008-49b1a8ea0a97 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.202059 Jun 24 08:44:51.470251 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 216/451] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:51 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:51.483514 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ad41cb2e-aa23-4241-935e-b9789a7082f9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:51.491567 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ad41cb2e-aa23-4241-935e-b9789a7082f9 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.193825 Jun 24 08:44:51.492132 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 236/452] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:51 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:52.485936 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1d2cabfb-d47a-43c3-9bf0-241438b287ca tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:52.486455 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1d2cabfb-d47a-43c3-9bf0-241438b287ca tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:52.493667 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1d2cabfb-d47a-43c3-9bf0-241438b287ca tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:52.494111 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1d2cabfb-d47a-43c3-9bf0-241438b287ca tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:52.494931 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1d2cabfb-d47a-43c3-9bf0-241438b287ca tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:52.495392 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1d2cabfb-d47a-43c3-9bf0-241438b287ca tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:52.508370 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-831e224a-82cd-4b4c-ad7a-0228d8b95207 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:52.508988 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-831e224a-82cd-4b4c-ad7a-0228d8b95207 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:52.514916 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-831e224a-82cd-4b4c-ad7a-0228d8b95207 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:52.515398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-831e224a-82cd-4b4c-ad7a-0228d8b95207 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:52.516160 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-831e224a-82cd-4b4c-ad7a-0228d8b95207 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:52.516654 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-831e224a-82cd-4b4c-ad7a-0228d8b95207 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:52.686651 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1d2cabfb-d47a-43c3-9bf0-241438b287ca tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:52.694238 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1d2cabfb-d47a-43c3-9bf0-241438b287ca tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.212146 Jun 24 08:44:52.694800 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 217/453] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:52 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:52.700811 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-831e224a-82cd-4b4c-ad7a-0228d8b95207 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:52.708769 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-831e224a-82cd-4b4c-ad7a-0228d8b95207 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.204281 Jun 24 08:44:52.709309 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 237/454] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:52 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:53.709523 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-925e0341-3ae1-4df3-b1da-7b419f4d59df tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:53.710136 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-925e0341-3ae1-4df3-b1da-7b419f4d59df tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:53.716224 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-925e0341-3ae1-4df3-b1da-7b419f4d59df tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:53.716691 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-925e0341-3ae1-4df3-b1da-7b419f4d59df tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:53.717435 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-925e0341-3ae1-4df3-b1da-7b419f4d59df tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:53.717870 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-925e0341-3ae1-4df3-b1da-7b419f4d59df tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:53.726157 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ff0b165c-15c9-46fd-a79f-7da2a792662c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:53.726760 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ff0b165c-15c9-46fd-a79f-7da2a792662c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:53.733087 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ff0b165c-15c9-46fd-a79f-7da2a792662c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:53.733531 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ff0b165c-15c9-46fd-a79f-7da2a792662c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:53.734290 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ff0b165c-15c9-46fd-a79f-7da2a792662c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:53.734716 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ff0b165c-15c9-46fd-a79f-7da2a792662c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:53.919600 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-925e0341-3ae1-4df3-b1da-7b419f4d59df tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:53.922834 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ff0b165c-15c9-46fd-a79f-7da2a792662c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:53.927795 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-925e0341-3ae1-4df3-b1da-7b419f4d59df tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.221994 Jun 24 08:44:53.928557 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 218/455] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:53 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:53.930923 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ff0b165c-15c9-46fd-a79f-7da2a792662c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.209322 Jun 24 08:44:53.931506 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 238/456] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:53 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:54.945210 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8a78deed-2638-4505-b1b0-1c4ebe2e5d40 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:54.945853 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8a78deed-2638-4505-b1b0-1c4ebe2e5d40 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:54.948356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7ccd1d98-39c4-4125-bfa1-d7ebd527c77d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:54.948976 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7ccd1d98-39c4-4125-bfa1-d7ebd527c77d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:54.952979 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8a78deed-2638-4505-b1b0-1c4ebe2e5d40 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:54.953434 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8a78deed-2638-4505-b1b0-1c4ebe2e5d40 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:54.954766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8a78deed-2638-4505-b1b0-1c4ebe2e5d40 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:54.954766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8a78deed-2638-4505-b1b0-1c4ebe2e5d40 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:54.957180 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7ccd1d98-39c4-4125-bfa1-d7ebd527c77d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:54.957919 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7ccd1d98-39c4-4125-bfa1-d7ebd527c77d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:54.958784 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7ccd1d98-39c4-4125-bfa1-d7ebd527c77d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:54.959431 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7ccd1d98-39c4-4125-bfa1-d7ebd527c77d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:55.187988 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8a78deed-2638-4505-b1b0-1c4ebe2e5d40 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:55.192317 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7ccd1d98-39c4-4125-bfa1-d7ebd527c77d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:55.196897 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8a78deed-2638-4505-b1b0-1c4ebe2e5d40 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.255596 Jun 24 08:44:55.198006 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 219/457] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:54 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:55.212192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7ccd1d98-39c4-4125-bfa1-d7ebd527c77d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.268548 Jun 24 08:44:55.222767 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 239/458] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:54 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:56.214254 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a60bcf63-2046-4eb3-a1d7-34bf435ac39e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:56.221201 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a60bcf63-2046-4eb3-a1d7-34bf435ac39e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:56.230028 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-264d4e16-1d9b-4ecb-a58e-6e598129d743 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:56.231500 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-264d4e16-1d9b-4ecb-a58e-6e598129d743 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:56.236732 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:56.239540 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a60bcf63-2046-4eb3-a1d7-34bf435ac39e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:56.240858 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a60bcf63-2046-4eb3-a1d7-34bf435ac39e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:56.241842 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a60bcf63-2046-4eb3-a1d7-34bf435ac39e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:56.242434 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a60bcf63-2046-4eb3-a1d7-34bf435ac39e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:56.249065 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-264d4e16-1d9b-4ecb-a58e-6e598129d743 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:56.250307 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-264d4e16-1d9b-4ecb-a58e-6e598129d743 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:56.252131 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-264d4e16-1d9b-4ecb-a58e-6e598129d743 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:56.253570 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-264d4e16-1d9b-4ecb-a58e-6e598129d743 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:56.479790 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-264d4e16-1d9b-4ecb-a58e-6e598129d743 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:56.494277 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-264d4e16-1d9b-4ecb-a58e-6e598129d743 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.268401 Jun 24 08:44:56.494869 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 240/459] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:56 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:56.503132 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-c9be1af3-8903-4eab-a7c5-c168ce41ad93 req-38120230-516e-4db2-8e13-cc87287d9589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73106291-ded8-47c4-8b9f-6ee2c7fe3926", "tag": "431156a0-7086-4030-a88f-b4d0acbdcfb2"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:56.503544 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a60bcf63-2046-4eb3-a1d7-34bf435ac39e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:56.511792 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a60bcf63-2046-4eb3-a1d7-34bf435ac39e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.301415 Jun 24 08:44:56.521624 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 220/460] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:56 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:56.531682 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-c9be1af3-8903-4eab-a7c5-c168ce41ad93 req-38120230-516e-4db2-8e13-cc87287d9589 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:56.531682 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-c9be1af3-8903-4eab-a7c5-c168ce41ad93 req-38120230-516e-4db2-8e13-cc87287d9589 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:56.532870 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:56.550773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-c9be1af3-8903-4eab-a7c5-c168ce41ad93 req-38120230-516e-4db2-8e13-cc87287d9589 service nova] Creating event network-changed:431156a0-7086-4030-a88f-b4d0acbdcfb2 for instance 73106291-ded8-47c4-8b9f-6ee2c7fe3926 on hv-cinder-84517 Jun 24 08:44:56.555873 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-c9be1af3-8903-4eab-a7c5-c168ce41ad93 req-38120230-516e-4db2-8e13-cc87287d9589 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058933 Jun 24 08:44:56.556547 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 241/461] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:57.511982 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2f1cbc21-298f-4ce9-850e-e3dd903b38c1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:57.512610 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2f1cbc21-298f-4ce9-850e-e3dd903b38c1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:57.519891 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f1cbc21-298f-4ce9-850e-e3dd903b38c1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:57.520332 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f1cbc21-298f-4ce9-850e-e3dd903b38c1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:57.521086 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f1cbc21-298f-4ce9-850e-e3dd903b38c1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:57.521578 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2f1cbc21-298f-4ce9-850e-e3dd903b38c1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:57.529843 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b3992be7-ba3e-40e7-a288-31d91ab99db7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:57.530543 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b3992be7-ba3e-40e7-a288-31d91ab99db7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:57.536834 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3992be7-ba3e-40e7-a288-31d91ab99db7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:57.537754 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3992be7-ba3e-40e7-a288-31d91ab99db7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:57.538294 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3992be7-ba3e-40e7-a288-31d91ab99db7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:57.538480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3992be7-ba3e-40e7-a288-31d91ab99db7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:57.726110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2f1cbc21-298f-4ce9-850e-e3dd903b38c1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:57.730442 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b3992be7-ba3e-40e7-a288-31d91ab99db7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:57.733871 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2f1cbc21-298f-4ce9-850e-e3dd903b38c1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.225628 Jun 24 08:44:57.734482 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 221/462] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:57 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:57.738069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b3992be7-ba3e-40e7-a288-31d91ab99db7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.213483 Jun 24 08:44:57.738621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 242/463] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:57 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:58.752940 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-604cc0c3-9dff-4123-aa30-26ed354a6a26 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:58.753591 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-604cc0c3-9dff-4123-aa30-26ed354a6a26 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:58.755022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f0386586-2857-440e-958b-257c7e8e2ce3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:58.755666 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f0386586-2857-440e-958b-257c7e8e2ce3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:58.760551 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-604cc0c3-9dff-4123-aa30-26ed354a6a26 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:58.761152 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-604cc0c3-9dff-4123-aa30-26ed354a6a26 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:58.762441 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-604cc0c3-9dff-4123-aa30-26ed354a6a26 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:58.762885 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-604cc0c3-9dff-4123-aa30-26ed354a6a26 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:58.763082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f0386586-2857-440e-958b-257c7e8e2ce3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:58.763642 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f0386586-2857-440e-958b-257c7e8e2ce3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:58.764494 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f0386586-2857-440e-958b-257c7e8e2ce3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:58.765030 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f0386586-2857-440e-958b-257c7e8e2ce3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:58.965473 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f0386586-2857-440e-958b-257c7e8e2ce3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:58.969569 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-604cc0c3-9dff-4123-aa30-26ed354a6a26 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:58.974517 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f0386586-2857-440e-958b-257c7e8e2ce3 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.223352 Jun 24 08:44:58.975183 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 243/464] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:58 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:58.977394 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-604cc0c3-9dff-4123-aa30-26ed354a6a26 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.228921 Jun 24 08:44:58.977951 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 222/465] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:58 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:59.992598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-13f336bb-9185-4775-aae8-a9824fc3a355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:59.993204 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-13f336bb-9185-4775-aae8-a9824fc3a355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:59.995777 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8054acd6-c545-4229-a72c-3e51c377461c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:59.996563 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8054acd6-c545-4229-a72c-3e51c377461c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:59.999451 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13f336bb-9185-4775-aae8-a9824fc3a355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:59.999894 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13f336bb-9185-4775-aae8-a9824fc3a355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:00.000645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13f336bb-9185-4775-aae8-a9824fc3a355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:00.001075 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13f336bb-9185-4775-aae8-a9824fc3a355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:00.003685 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8054acd6-c545-4229-a72c-3e51c377461c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:00.004146 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8054acd6-c545-4229-a72c-3e51c377461c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:00.004919 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8054acd6-c545-4229-a72c-3e51c377461c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:00.005364 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8054acd6-c545-4229-a72c-3e51c377461c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:00.204137 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-13f336bb-9185-4775-aae8-a9824fc3a355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:00.207106 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8054acd6-c545-4229-a72c-3e51c377461c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:00.211895 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-13f336bb-9185-4775-aae8-a9824fc3a355 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.223149 Jun 24 08:45:00.212953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 244/466] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:59 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:00.215176 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8054acd6-c545-4229-a72c-3e51c377461c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.223363 Jun 24 08:45:00.215771 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 223/467] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:59 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:01.229394 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-aad48626-e53e-468e-9c7e-06327257950d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:01.230084 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-aad48626-e53e-468e-9c7e-06327257950d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:01.232372 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b2c7e0be-0e14-499d-8f7d-e70bcbc884fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:01.232978 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b2c7e0be-0e14-499d-8f7d-e70bcbc884fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:01.236796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aad48626-e53e-468e-9c7e-06327257950d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:01.237781 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aad48626-e53e-468e-9c7e-06327257950d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:01.238671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aad48626-e53e-468e-9c7e-06327257950d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:01.239146 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aad48626-e53e-468e-9c7e-06327257950d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:01.239919 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2c7e0be-0e14-499d-8f7d-e70bcbc884fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:01.240370 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2c7e0be-0e14-499d-8f7d-e70bcbc884fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:01.241119 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2c7e0be-0e14-499d-8f7d-e70bcbc884fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:01.241545 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2c7e0be-0e14-499d-8f7d-e70bcbc884fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:01.448733 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b2c7e0be-0e14-499d-8f7d-e70bcbc884fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:01.452285 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-aad48626-e53e-468e-9c7e-06327257950d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:01.456731 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b2c7e0be-0e14-499d-8f7d-e70bcbc884fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.227568 Jun 24 08:45:01.457307 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 224/468] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:01 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:01.460376 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-aad48626-e53e-468e-9c7e-06327257950d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.235012 Jun 24 08:45:01.460929 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 245/469] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:01 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:02.474396 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-16077d83-e004-48ff-ad45-03875a0d1300 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:02.474910 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-16077d83-e004-48ff-ad45-03875a0d1300 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:02.477102 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2896c4ae-fd5a-407c-ab72-cc796f62dcdc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:02.477784 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2896c4ae-fd5a-407c-ab72-cc796f62dcdc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:02.481513 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16077d83-e004-48ff-ad45-03875a0d1300 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:02.481963 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16077d83-e004-48ff-ad45-03875a0d1300 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:02.482726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16077d83-e004-48ff-ad45-03875a0d1300 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:02.483157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16077d83-e004-48ff-ad45-03875a0d1300 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:02.483981 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2896c4ae-fd5a-407c-ab72-cc796f62dcdc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:02.484453 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2896c4ae-fd5a-407c-ab72-cc796f62dcdc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:02.485268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2896c4ae-fd5a-407c-ab72-cc796f62dcdc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:02.485748 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2896c4ae-fd5a-407c-ab72-cc796f62dcdc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:02.683453 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-16077d83-e004-48ff-ad45-03875a0d1300 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:02.687641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2896c4ae-fd5a-407c-ab72-cc796f62dcdc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:02.692801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-16077d83-e004-48ff-ad45-03875a0d1300 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.222905 Jun 24 08:45:02.693590 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 225/470] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:02 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:02.696074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2896c4ae-fd5a-407c-ab72-cc796f62dcdc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.223073 Jun 24 08:45:02.700616 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 246/471] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:02 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:03.710951 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dc95ada5-b06b-4cc1-9dd5-1129594a4fb2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:03.711577 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dc95ada5-b06b-4cc1-9dd5-1129594a4fb2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:03.712663 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-08ca6e7f-7956-470b-a21d-32067b81b7b2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:03.713545 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-08ca6e7f-7956-470b-a21d-32067b81b7b2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:03.718103 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc95ada5-b06b-4cc1-9dd5-1129594a4fb2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:03.718559 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc95ada5-b06b-4cc1-9dd5-1129594a4fb2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:03.719515 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc95ada5-b06b-4cc1-9dd5-1129594a4fb2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:03.719659 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-08ca6e7f-7956-470b-a21d-32067b81b7b2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:03.719980 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc95ada5-b06b-4cc1-9dd5-1129594a4fb2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:03.720244 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-08ca6e7f-7956-470b-a21d-32067b81b7b2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:03.721037 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-08ca6e7f-7956-470b-a21d-32067b81b7b2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:03.721469 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-08ca6e7f-7956-470b-a21d-32067b81b7b2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:03.916163 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dc95ada5-b06b-4cc1-9dd5-1129594a4fb2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:03.925452 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-08ca6e7f-7956-470b-a21d-32067b81b7b2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:03.925671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dc95ada5-b06b-4cc1-9dd5-1129594a4fb2 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.218365 Jun 24 08:45:03.935570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 226/472] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:03 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:03.937649 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-08ca6e7f-7956-470b-a21d-32067b81b7b2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.228718 Jun 24 08:45:03.938238 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 247/473] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:03 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:04.596380 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-c4cbf878-e3cf-493c-be4c-697569f6bb20 req-496ad342-52d8-477e-8447-7d74ad33d99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9a15b4-2e8f-47c3-88f1-95b5c4755c92", "name": "network-vif-plugged", "status": "completed", "tag": "2a1e43f9-7be3-4e9c-9137-a737077baa15"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:04.604588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-c4cbf878-e3cf-493c-be4c-697569f6bb20 req-496ad342-52d8-477e-8447-7d74ad33d99d service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:04.605036 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-c4cbf878-e3cf-493c-be4c-697569f6bb20 req-496ad342-52d8-477e-8447-7d74ad33d99d service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:04.616396 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-c4cbf878-e3cf-493c-be4c-697569f6bb20 req-496ad342-52d8-477e-8447-7d74ad33d99d service nova] Creating event network-vif-plugged:2a1e43f9-7be3-4e9c-9137-a737077baa15 for instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 on hv-cinder-84517 Jun 24 08:45:04.621414 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-c4cbf878-e3cf-493c-be4c-697569f6bb20 req-496ad342-52d8-477e-8447-7d74ad33d99d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029275 Jun 24 08:45:04.622016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 227/474] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:04.942285 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-32797d5b-afe9-47ef-9a68-21b54afb473e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:04.942904 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-32797d5b-afe9-47ef-9a68-21b54afb473e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:04.948951 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32797d5b-afe9-47ef-9a68-21b54afb473e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:04.949406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32797d5b-afe9-47ef-9a68-21b54afb473e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:04.950176 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32797d5b-afe9-47ef-9a68-21b54afb473e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:04.950612 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32797d5b-afe9-47ef-9a68-21b54afb473e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:04.956537 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-714aca3f-0b8c-4be8-91c8-4ab666c419d1 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:04.960577 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-714aca3f-0b8c-4be8-91c8-4ab666c419d1 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:04.968459 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-714aca3f-0b8c-4be8-91c8-4ab666c419d1 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:04.969153 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-714aca3f-0b8c-4be8-91c8-4ab666c419d1 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:04.970089 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-714aca3f-0b8c-4be8-91c8-4ab666c419d1 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:04.970544 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-714aca3f-0b8c-4be8-91c8-4ab666c419d1 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:05.173742 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-714aca3f-0b8c-4be8-91c8-4ab666c419d1 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:05.182209 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-714aca3f-0b8c-4be8-91c8-4ab666c419d1 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.230911 Jun 24 08:45:05.182433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-32797d5b-afe9-47ef-9a68-21b54afb473e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:05.184653 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 228/475] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:04 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:05.190296 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-32797d5b-afe9-47ef-9a68-21b54afb473e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.252269 Jun 24 08:45:05.190877 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 248/476] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:04 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:06.200281 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4b83662d-9a33-4922-9779-21ad45553271 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:06.202324 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4b83662d-9a33-4922-9779-21ad45553271 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:06.207990 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-454d527e-7e3a-4549-8929-88f2fa8d77d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:06.209276 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-454d527e-7e3a-4549-8929-88f2fa8d77d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:06.209992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4b83662d-9a33-4922-9779-21ad45553271 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:06.210437 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4b83662d-9a33-4922-9779-21ad45553271 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:06.211342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4b83662d-9a33-4922-9779-21ad45553271 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:06.211821 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4b83662d-9a33-4922-9779-21ad45553271 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:06.216079 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-454d527e-7e3a-4549-8929-88f2fa8d77d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:06.216520 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-454d527e-7e3a-4549-8929-88f2fa8d77d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:06.217316 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-454d527e-7e3a-4549-8929-88f2fa8d77d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:06.217748 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-454d527e-7e3a-4549-8929-88f2fa8d77d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:06.237833 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:06.436468 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-454d527e-7e3a-4549-8929-88f2fa8d77d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:06.441484 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4b83662d-9a33-4922-9779-21ad45553271 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:06.445607 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-454d527e-7e3a-4549-8929-88f2fa8d77d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1369 microversion: 2.1 time: 0.242192 Jun 24 08:45:06.446180 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 249/477] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:06 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1369 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:06.450053 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4b83662d-9a33-4922-9779-21ad45553271 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.253509 Jun 24 08:45:06.451202 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 229/478] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:06 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:07.463934 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-60f7d4a9-2bd8-4714-97d8-ff6d98a2a830 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:07.464574 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-60f7d4a9-2bd8-4714-97d8-ff6d98a2a830 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:07.467054 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e9328f53-587b-4a3b-87f9-ccbc803a51f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:07.467872 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e9328f53-587b-4a3b-87f9-ccbc803a51f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:07.470618 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-60f7d4a9-2bd8-4714-97d8-ff6d98a2a830 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:07.471065 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-60f7d4a9-2bd8-4714-97d8-ff6d98a2a830 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:07.472363 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-60f7d4a9-2bd8-4714-97d8-ff6d98a2a830 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:07.472792 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-60f7d4a9-2bd8-4714-97d8-ff6d98a2a830 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:07.474797 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9328f53-587b-4a3b-87f9-ccbc803a51f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:07.475273 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9328f53-587b-4a3b-87f9-ccbc803a51f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:07.476030 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9328f53-587b-4a3b-87f9-ccbc803a51f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:07.477886 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9328f53-587b-4a3b-87f9-ccbc803a51f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:07.665695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-60f7d4a9-2bd8-4714-97d8-ff6d98a2a830 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:07.673683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-60f7d4a9-2bd8-4714-97d8-ff6d98a2a830 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1563 microversion: 2.1 time: 0.213766 Jun 24 08:45:07.674439 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 250/479] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:07 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1563 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:07.674575 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e9328f53-587b-4a3b-87f9-ccbc803a51f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:07.684283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e9328f53-587b-4a3b-87f9-ccbc803a51f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.221076 Jun 24 08:45:07.685135 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 230/480] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:07 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:07.690521 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-673c8c6f-906f-4d6a-a0a9-a60a81a19162 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:07.691015 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-673c8c6f-906f-4d6a-a0a9-a60a81a19162 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:07.697092 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-673c8c6f-906f-4d6a-a0a9-a60a81a19162 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:07.697539 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-673c8c6f-906f-4d6a-a0a9-a60a81a19162 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:07.698302 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-673c8c6f-906f-4d6a-a0a9-a60a81a19162 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:07.698732 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-673c8c6f-906f-4d6a-a0a9-a60a81a19162 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:07.780545 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-673c8c6f-906f-4d6a-a0a9-a60a81a19162 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093992 Jun 24 08:45:07.781272 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 251/481] 10.222.0.43 () {58 vars in 1274 bytes} [Fri Jun 24 08:45:07 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:08.700076 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4836ea9f-e488-4401-a7de-8b61f25795fb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:08.700797 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4836ea9f-e488-4401-a7de-8b61f25795fb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:08.707237 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4836ea9f-e488-4401-a7de-8b61f25795fb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:08.707715 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4836ea9f-e488-4401-a7de-8b61f25795fb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:08.708477 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4836ea9f-e488-4401-a7de-8b61f25795fb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:08.708907 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4836ea9f-e488-4401-a7de-8b61f25795fb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:08.783016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-abfadfbf-072a-47aa-9819-7308d68995f2 req-f1c71549-57c3-4997-8507-abdd11a204d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d9a15b4-2e8f-47c3-88f1-95b5c4755c92", "tag": "2a1e43f9-7be3-4e9c-9137-a737077baa15"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:08.792408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-abfadfbf-072a-47aa-9819-7308d68995f2 req-f1c71549-57c3-4997-8507-abdd11a204d8 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:08.792855 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-abfadfbf-072a-47aa-9819-7308d68995f2 req-f1c71549-57c3-4997-8507-abdd11a204d8 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:08.807727 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-abfadfbf-072a-47aa-9819-7308d68995f2 req-f1c71549-57c3-4997-8507-abdd11a204d8 service nova] Creating event network-changed:2a1e43f9-7be3-4e9c-9137-a737077baa15 for instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 on hv-cinder-84517 Jun 24 08:45:08.814568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-abfadfbf-072a-47aa-9819-7308d68995f2 req-f1c71549-57c3-4997-8507-abdd11a204d8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034466 Jun 24 08:45:08.815988 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 252/482] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:45:08.863006 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4836ea9f-e488-4401-a7de-8b61f25795fb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:08.871886 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4836ea9f-e488-4401-a7de-8b61f25795fb tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.175557 Jun 24 08:45:08.872675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 231/483] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:08 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:09.889893 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-90e09a62-53dc-4231-935c-535bb0eb76ea tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:09.890586 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-90e09a62-53dc-4231-935c-535bb0eb76ea tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:09.897316 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-90e09a62-53dc-4231-935c-535bb0eb76ea tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:09.897760 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-90e09a62-53dc-4231-935c-535bb0eb76ea tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:09.898516 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-90e09a62-53dc-4231-935c-535bb0eb76ea tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:09.898942 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-90e09a62-53dc-4231-935c-535bb0eb76ea tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:10.029775 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-90e09a62-53dc-4231-935c-535bb0eb76ea tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:10.037704 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-90e09a62-53dc-4231-935c-535bb0eb76ea tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.151978 Jun 24 08:45:10.038791 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 253/484] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:09 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:11.055367 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6c955a14-a0a1-4b51-a01c-db54a5cc7ae7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:11.055977 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6c955a14-a0a1-4b51-a01c-db54a5cc7ae7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:11.062116 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c955a14-a0a1-4b51-a01c-db54a5cc7ae7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:11.062563 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c955a14-a0a1-4b51-a01c-db54a5cc7ae7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:11.063354 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c955a14-a0a1-4b51-a01c-db54a5cc7ae7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:11.063788 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6c955a14-a0a1-4b51-a01c-db54a5cc7ae7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:11.195235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6c955a14-a0a1-4b51-a01c-db54a5cc7ae7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:11.202638 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6c955a14-a0a1-4b51-a01c-db54a5cc7ae7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.151182 Jun 24 08:45:11.203199 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 232/485] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:11 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:12.219860 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-83981f7d-cbcb-4684-b8a3-15047d38589c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:12.220491 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-83981f7d-cbcb-4684-b8a3-15047d38589c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:12.227420 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-83981f7d-cbcb-4684-b8a3-15047d38589c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:12.227878 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-83981f7d-cbcb-4684-b8a3-15047d38589c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:12.228657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-83981f7d-cbcb-4684-b8a3-15047d38589c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:12.229097 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-83981f7d-cbcb-4684-b8a3-15047d38589c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:12.359299 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-83981f7d-cbcb-4684-b8a3-15047d38589c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:12.367008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-83981f7d-cbcb-4684-b8a3-15047d38589c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.150980 Jun 24 08:45:12.367594 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 254/486] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:12 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:13.384195 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-32fd433d-b1f4-4785-8c86-b6d47c4cae21 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:13.384820 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-32fd433d-b1f4-4785-8c86-b6d47c4cae21 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:13.394460 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32fd433d-b1f4-4785-8c86-b6d47c4cae21 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:13.394908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32fd433d-b1f4-4785-8c86-b6d47c4cae21 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:13.395744 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32fd433d-b1f4-4785-8c86-b6d47c4cae21 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:13.396179 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-32fd433d-b1f4-4785-8c86-b6d47c4cae21 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:13.544564 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-32fd433d-b1f4-4785-8c86-b6d47c4cae21 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:13.552918 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-32fd433d-b1f4-4785-8c86-b6d47c4cae21 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.172531 Jun 24 08:45:13.553540 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 233/487] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:13 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:14.569557 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-38e89f9f-15d1-4085-9956-1331c67cc64d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:14.570166 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-38e89f9f-15d1-4085-9956-1331c67cc64d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:14.576419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-38e89f9f-15d1-4085-9956-1331c67cc64d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:14.576893 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-38e89f9f-15d1-4085-9956-1331c67cc64d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:14.577701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-38e89f9f-15d1-4085-9956-1331c67cc64d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:14.578170 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-38e89f9f-15d1-4085-9956-1331c67cc64d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:14.710461 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-38e89f9f-15d1-4085-9956-1331c67cc64d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:14.717959 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-38e89f9f-15d1-4085-9956-1331c67cc64d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.152136 Jun 24 08:45:14.718461 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 255/488] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:14 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:14.883133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-fc11dca5-d147-4f9d-84a5-8a9f3df6735a req-01d0cb63-f58e-4cf7-b222-3ff13e19dfec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73106291-ded8-47c4-8b9f-6ee2c7fe3926", "name": "network-vif-plugged", "status": "completed", "tag": "431156a0-7086-4030-a88f-b4d0acbdcfb2"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:14.888244 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=48 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:14.892314 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-fc11dca5-d147-4f9d-84a5-8a9f3df6735a req-01d0cb63-f58e-4cf7-b222-3ff13e19dfec service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:14.892803 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-fc11dca5-d147-4f9d-84a5-8a9f3df6735a req-01d0cb63-f58e-4cf7-b222-3ff13e19dfec service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:14.904555 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-fc11dca5-d147-4f9d-84a5-8a9f3df6735a req-01d0cb63-f58e-4cf7-b222-3ff13e19dfec service nova] Creating event network-vif-plugged:431156a0-7086-4030-a88f-b4d0acbdcfb2 for instance 73106291-ded8-47c4-8b9f-6ee2c7fe3926 on hv-cinder-84517 Jun 24 08:45:14.909428 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-fc11dca5-d147-4f9d-84a5-8a9f3df6735a req-01d0cb63-f58e-4cf7-b222-3ff13e19dfec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030301 Jun 24 08:45:14.910090 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 234/489] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:15.735028 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-964382f9-2b49-4faf-9f37-77527a372d64 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:15.735670 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-964382f9-2b49-4faf-9f37-77527a372d64 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:15.742336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-964382f9-2b49-4faf-9f37-77527a372d64 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:15.742783 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-964382f9-2b49-4faf-9f37-77527a372d64 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:15.743588 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-964382f9-2b49-4faf-9f37-77527a372d64 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:15.744027 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-964382f9-2b49-4faf-9f37-77527a372d64 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:15.873150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-964382f9-2b49-4faf-9f37-77527a372d64 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:15.880544 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-964382f9-2b49-4faf-9f37-77527a372d64 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.149379 Jun 24 08:45:15.881099 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 256/490] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:15 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:16.898154 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c5256441-5ca6-4e35-bd4a-4cb892ec5712 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:16.898878 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c5256441-5ca6-4e35-bd4a-4cb892ec5712 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:16.905100 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c5256441-5ca6-4e35-bd4a-4cb892ec5712 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:16.905547 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c5256441-5ca6-4e35-bd4a-4cb892ec5712 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:16.906306 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c5256441-5ca6-4e35-bd4a-4cb892ec5712 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:16.906743 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c5256441-5ca6-4e35-bd4a-4cb892ec5712 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:17.289600 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c5256441-5ca6-4e35-bd4a-4cb892ec5712 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:17.297385 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c5256441-5ca6-4e35-bd4a-4cb892ec5712 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1259 microversion: 2.1 time: 0.403932 Jun 24 08:45:17.297938 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 235/491] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:16 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1259 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:18.314530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9e5f5706-178c-4b5c-a41b-d013124a4907 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:18.315738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9e5f5706-178c-4b5c-a41b-d013124a4907 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:18.321812 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e5f5706-178c-4b5c-a41b-d013124a4907 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:18.322259 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e5f5706-178c-4b5c-a41b-d013124a4907 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:18.323134 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e5f5706-178c-4b5c-a41b-d013124a4907 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:18.323632 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e5f5706-178c-4b5c-a41b-d013124a4907 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:18.464250 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9e5f5706-178c-4b5c-a41b-d013124a4907 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:18.471890 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9e5f5706-178c-4b5c-a41b-d013124a4907 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1442 microversion: 2.1 time: 0.161264 Jun 24 08:45:18.472467 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 257/492] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:18 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1442 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:18.487949 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-67ab06a7-9fd8-443f-9f96-b0b9dd895498 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:18.488559 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-67ab06a7-9fd8-443f-9f96-b0b9dd895498 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:18.494930 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-67ab06a7-9fd8-443f-9f96-b0b9dd895498 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:18.495422 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-67ab06a7-9fd8-443f-9f96-b0b9dd895498 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:18.496209 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-67ab06a7-9fd8-443f-9f96-b0b9dd895498 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:18.496649 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-67ab06a7-9fd8-443f-9f96-b0b9dd895498 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:18.628614 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-67ab06a7-9fd8-443f-9f96-b0b9dd895498 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:18.636215 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-67ab06a7-9fd8-443f-9f96-b0b9dd895498 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1442 microversion: 2.1 time: 0.151907 Jun 24 08:45:18.637216 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 236/493] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:18 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1442 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:20.376445 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-96cab4b2-47f7-4e87-9bce-383088bb5bf1 req-791a322a-141c-46ca-8bd0-a609e6cd5822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73106291-ded8-47c4-8b9f-6ee2c7fe3926", "tag": "431156a0-7086-4030-a88f-b4d0acbdcfb2"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:20.385767 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-96cab4b2-47f7-4e87-9bce-383088bb5bf1 req-791a322a-141c-46ca-8bd0-a609e6cd5822 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:20.386385 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-96cab4b2-47f7-4e87-9bce-383088bb5bf1 req-791a322a-141c-46ca-8bd0-a609e6cd5822 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:20.398242 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-96cab4b2-47f7-4e87-9bce-383088bb5bf1 req-791a322a-141c-46ca-8bd0-a609e6cd5822 service nova] Creating event network-changed:431156a0-7086-4030-a88f-b4d0acbdcfb2 for instance 73106291-ded8-47c4-8b9f-6ee2c7fe3926 on hv-cinder-84517 Jun 24 08:45:20.403286 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-96cab4b2-47f7-4e87-9bce-383088bb5bf1 req-791a322a-141c-46ca-8bd0-a609e6cd5822 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030797 Jun 24 08:45:20.404054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 258/494] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:20.971244 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-73101783", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1167158324", "security_groups": [{"name": "tempest-secgroup-smoke-1577723221"}], "block_device_mapping_v2": [{"uuid": "d15aeb4a-a69d-422c-92d6-dbfa522c8f59", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ee4277a5-1041-408a-bfe3-ce6a3f8905d0"}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:21.097031 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] validate_networks() for [('ee4277a5-1041-408a-bfe3-ce6a3f8905d0', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:45:21.477168 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:45:21.477678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:45:21.478156 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:45:21.478684 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:45:21.479096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:45:21.488245 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:21.488784 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:21.489588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:21.490029 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:21.508328 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Getting quotas for project 891980c3542d4223a15461bb7c5dcff9. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:45:21.512413 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Getting quotas for user 7f65bea891fb461086d6a60177ff2d65 and project 891980c3542d4223a15461bb7c5dcff9. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:45:21.568745 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:45:21.570831 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d15aeb4a-a69d-422c-92d6-dbfa522c8f59',volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:45:21.698720 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ce0b03e0-46e3-4aec-8504-68d2a63dcf6f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731729 Jun 24 08:45:21.699386 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 237/495] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:45:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:45:21.710403 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-080b06ff-162a-4607-bff4-1962d1aa11f4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:21.711096 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-080b06ff-162a-4607-bff4-1962d1aa11f4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:21.764259 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-080b06ff-162a-4607-bff4-1962d1aa11f4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:21.771487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-080b06ff-162a-4607-bff4-1962d1aa11f4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1093 microversion: 2.1 time: 0.065804 Jun 24 08:45:21.772053 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 259/496] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:21 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:22.788374 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ccb28e1c-37c6-47b5-87bf-88e8060abda8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:22.789042 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ccb28e1c-37c6-47b5-87bf-88e8060abda8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:22.796351 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ccb28e1c-37c6-47b5-87bf-88e8060abda8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:22.796803 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ccb28e1c-37c6-47b5-87bf-88e8060abda8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:22.798153 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ccb28e1c-37c6-47b5-87bf-88e8060abda8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:22.798153 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ccb28e1c-37c6-47b5-87bf-88e8060abda8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:22.866519 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ccb28e1c-37c6-47b5-87bf-88e8060abda8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:22.874265 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ccb28e1c-37c6-47b5-87bf-88e8060abda8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1199 microversion: 2.1 time: 0.090215 Jun 24 08:45:22.874964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 238/497] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:22 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1199 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:23.891642 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a8433cb3-a637-41e3-9276-ac982b93e388 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:23.892245 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a8433cb3-a637-41e3-9276-ac982b93e388 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:23.898963 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a8433cb3-a637-41e3-9276-ac982b93e388 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:23.899437 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a8433cb3-a637-41e3-9276-ac982b93e388 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:23.900197 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a8433cb3-a637-41e3-9276-ac982b93e388 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:23.900806 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a8433cb3-a637-41e3-9276-ac982b93e388 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:24.054723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a8433cb3-a637-41e3-9276-ac982b93e388 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:24.063518 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a8433cb3-a637-41e3-9276-ac982b93e388 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1265 microversion: 2.1 time: 0.175612 Jun 24 08:45:24.064101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 260/498] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:23 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:24.155913 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-49e2c636-2a35-4588-9ce8-84e465222f9b req-745d9516-da46-41b5-8463-a0d9acf405b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7361cf5e-5979-4b93-97db-69e8a678dfa3", "tag": "4535b51a-3287-40ad-b3cf-f032fe1dd901"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:24.165563 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-49e2c636-2a35-4588-9ce8-84e465222f9b req-745d9516-da46-41b5-8463-a0d9acf405b1 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:24.166348 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-49e2c636-2a35-4588-9ce8-84e465222f9b req-745d9516-da46-41b5-8463-a0d9acf405b1 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:24.192473 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-49e2c636-2a35-4588-9ce8-84e465222f9b req-745d9516-da46-41b5-8463-a0d9acf405b1 service nova] Creating event network-changed:4535b51a-3287-40ad-b3cf-f032fe1dd901 for instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 on hv-cinder-84517 Jun 24 08:45:24.197321 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-49e2c636-2a35-4588-9ce8-84e465222f9b req-745d9516-da46-41b5-8463-a0d9acf405b1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046179 Jun 24 08:45:24.197924 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 239/499] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:45:25.081355 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d6cb3ea7-db13-4613-89e6-8c9a024cd0c8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:25.081961 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d6cb3ea7-db13-4613-89e6-8c9a024cd0c8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:25.088155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6cb3ea7-db13-4613-89e6-8c9a024cd0c8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:25.088593 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6cb3ea7-db13-4613-89e6-8c9a024cd0c8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:25.089345 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6cb3ea7-db13-4613-89e6-8c9a024cd0c8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:25.089771 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6cb3ea7-db13-4613-89e6-8c9a024cd0c8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:25.093759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:25.219794 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d6cb3ea7-db13-4613-89e6-8c9a024cd0c8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:25.227535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d6cb3ea7-db13-4613-89e6-8c9a024cd0c8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1265 microversion: 2.1 time: 0.150510 Jun 24 08:45:25.228089 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 261/500] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:25 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:25.764828 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e2bbc523-b3cc-4c5d-a5bd-98c9a71eb2eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:25.765406 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e2bbc523-b3cc-4c5d-a5bd-98c9a71eb2eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:25.771561 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2bbc523-b3cc-4c5d-a5bd-98c9a71eb2eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:25.772007 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2bbc523-b3cc-4c5d-a5bd-98c9a71eb2eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:25.772752 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2bbc523-b3cc-4c5d-a5bd-98c9a71eb2eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:25.773177 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2bbc523-b3cc-4c5d-a5bd-98c9a71eb2eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:25.795193 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e2bbc523-b3cc-4c5d-a5bd-98c9a71eb2eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/ips" status: 200 len: 152 microversion: 2.20 time: 0.035145 Jun 24 08:45:25.795755 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 240/501] 10.222.0.43 () {60 vars in 1288 bytes} [Fri Jun 24 08:45:25 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:45:26.244138 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-91d18e7b-1e61-4335-9eeb-674a5855043c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:26.244807 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-91d18e7b-1e61-4335-9eeb-674a5855043c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:26.250813 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-91d18e7b-1e61-4335-9eeb-674a5855043c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:26.251292 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-91d18e7b-1e61-4335-9eeb-674a5855043c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:26.252058 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-91d18e7b-1e61-4335-9eeb-674a5855043c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:26.252492 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-91d18e7b-1e61-4335-9eeb-674a5855043c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:26.379173 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-91d18e7b-1e61-4335-9eeb-674a5855043c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:26.386655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-91d18e7b-1e61-4335-9eeb-674a5855043c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1265 microversion: 2.1 time: 0.146394 Jun 24 08:45:26.387294 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 262/502] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:26 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:27.403357 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3d7b9ee6-2969-4686-a4c7-679865a0de67 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:27.403978 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3d7b9ee6-2969-4686-a4c7-679865a0de67 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:27.410546 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3d7b9ee6-2969-4686-a4c7-679865a0de67 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:27.411001 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3d7b9ee6-2969-4686-a4c7-679865a0de67 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:27.411810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3d7b9ee6-2969-4686-a4c7-679865a0de67 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:27.412248 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3d7b9ee6-2969-4686-a4c7-679865a0de67 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:27.544640 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3d7b9ee6-2969-4686-a4c7-679865a0de67 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:27.552682 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3d7b9ee6-2969-4686-a4c7-679865a0de67 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1265 microversion: 2.1 time: 0.153306 Jun 24 08:45:27.553249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 241/503] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:27 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:28.569354 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6f2f8026-8200-420c-ba11-fb334006b3c5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:28.569967 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6f2f8026-8200-420c-ba11-fb334006b3c5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:28.571856 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=48 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:28.577147 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6f2f8026-8200-420c-ba11-fb334006b3c5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:28.577591 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6f2f8026-8200-420c-ba11-fb334006b3c5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:28.578351 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6f2f8026-8200-420c-ba11-fb334006b3c5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:28.578787 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6f2f8026-8200-420c-ba11-fb334006b3c5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:28.691057 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3e6cde19-9228-4566-9a85-9d02b8fbc361 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:28.691658 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3e6cde19-9228-4566-9a85-9d02b8fbc361 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:28.698494 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e6cde19-9228-4566-9a85-9d02b8fbc361 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:28.698947 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e6cde19-9228-4566-9a85-9d02b8fbc361 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:28.699753 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e6cde19-9228-4566-9a85-9d02b8fbc361 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:28.700193 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3e6cde19-9228-4566-9a85-9d02b8fbc361 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:28.708802 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6f2f8026-8200-420c-ba11-fb334006b3c5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:28.716302 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6f2f8026-8200-420c-ba11-fb334006b3c5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1265 microversion: 2.1 time: 0.150877 Jun 24 08:45:28.716870 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 263/504] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:28 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:28.723574 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-3e6cde19-9228-4566-9a85-9d02b8fbc361 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lazy-loading 'flavor' on Instance uuid 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:45:28.976157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3e6cde19-9228-4566-9a85-9d02b8fbc361 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "POST /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/action" status: 202 len: 0 microversion: 2.20 time: 0.289609 Jun 24 08:45:28.976771 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 242/505] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Jun 24 08:45:28 2022] POST /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:45:28.984973 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ffb139dd-4aff-4f50-9d3e-74b8b34906da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:28.985585 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ffb139dd-4aff-4f50-9d3e-74b8b34906da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:28.992175 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ffb139dd-4aff-4f50-9d3e-74b8b34906da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:28.992608 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ffb139dd-4aff-4f50-9d3e-74b8b34906da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:28.993367 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ffb139dd-4aff-4f50-9d3e-74b8b34906da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:28.993798 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ffb139dd-4aff-4f50-9d3e-74b8b34906da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:29.120663 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ffb139dd-4aff-4f50-9d3e-74b8b34906da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:29.128611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ffb139dd-4aff-4f50-9d3e-74b8b34906da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:29.130127 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ffb139dd-4aff-4f50-9d3e-74b8b34906da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:29.131316 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ffb139dd-4aff-4f50-9d3e-74b8b34906da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.150257 Jun 24 08:45:29.131875 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 264/506] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:28 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:29.733249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d29978c0-5dc3-4d98-b97f-cc5a4b5ee455 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:29.733853 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d29978c0-5dc3-4d98-b97f-cc5a4b5ee455 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:29.740227 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d29978c0-5dc3-4d98-b97f-cc5a4b5ee455 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:29.740669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d29978c0-5dc3-4d98-b97f-cc5a4b5ee455 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:29.741575 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d29978c0-5dc3-4d98-b97f-cc5a4b5ee455 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:29.742011 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d29978c0-5dc3-4d98-b97f-cc5a4b5ee455 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:29.873250 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d29978c0-5dc3-4d98-b97f-cc5a4b5ee455 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:29.880543 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d29978c0-5dc3-4d98-b97f-cc5a4b5ee455 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1265 microversion: 2.1 time: 0.152085 Jun 24 08:45:29.881098 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 243/507] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:29 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:30.150025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-369cc22a-cf4b-467e-977b-7b7b8cfccbbf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:30.150629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-369cc22a-cf4b-467e-977b-7b7b8cfccbbf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:30.156606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-369cc22a-cf4b-467e-977b-7b7b8cfccbbf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:30.157045 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-369cc22a-cf4b-467e-977b-7b7b8cfccbbf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:30.157793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-369cc22a-cf4b-467e-977b-7b7b8cfccbbf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:30.158223 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-369cc22a-cf4b-467e-977b-7b7b8cfccbbf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:30.281895 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-369cc22a-cf4b-467e-977b-7b7b8cfccbbf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:30.290022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-369cc22a-cf4b-467e-977b-7b7b8cfccbbf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:30.291622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-369cc22a-cf4b-467e-977b-7b7b8cfccbbf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:30.292767 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-369cc22a-cf4b-467e-977b-7b7b8cfccbbf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.146619 Jun 24 08:45:30.293324 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 265/508] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:30 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:30.897193 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-65514eba-efe2-47a2-9772-476063c2cac3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:30.897793 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-65514eba-efe2-47a2-9772-476063c2cac3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:30.904311 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65514eba-efe2-47a2-9772-476063c2cac3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:30.904751 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65514eba-efe2-47a2-9772-476063c2cac3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:30.905499 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65514eba-efe2-47a2-9772-476063c2cac3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:30.905923 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-65514eba-efe2-47a2-9772-476063c2cac3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:31.039024 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-65514eba-efe2-47a2-9772-476063c2cac3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:31.046554 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-65514eba-efe2-47a2-9772-476063c2cac3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1265 microversion: 2.1 time: 0.153235 Jun 24 08:45:31.047147 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 244/509] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:30 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:31.311684 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6389fc1d-136e-4fad-bb88-129f1e400d4a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:31.312297 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6389fc1d-136e-4fad-bb88-129f1e400d4a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:31.318503 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6389fc1d-136e-4fad-bb88-129f1e400d4a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:31.318948 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6389fc1d-136e-4fad-bb88-129f1e400d4a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:31.319744 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6389fc1d-136e-4fad-bb88-129f1e400d4a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:31.320178 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6389fc1d-136e-4fad-bb88-129f1e400d4a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:31.452538 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6389fc1d-136e-4fad-bb88-129f1e400d4a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:31.460568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6389fc1d-136e-4fad-bb88-129f1e400d4a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:31.462189 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6389fc1d-136e-4fad-bb88-129f1e400d4a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:31.463360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6389fc1d-136e-4fad-bb88-129f1e400d4a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.155568 Jun 24 08:45:31.463903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 266/510] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:31 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:32.063410 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-891c31a1-ec6f-44d5-88b9-a3d88180cecf tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:32.063958 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-891c31a1-ec6f-44d5-88b9-a3d88180cecf tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:32.066446 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:32.067097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:32.073615 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-891c31a1-ec6f-44d5-88b9-a3d88180cecf tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:32.074093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-891c31a1-ec6f-44d5-88b9-a3d88180cecf tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:32.074855 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-891c31a1-ec6f-44d5-88b9-a3d88180cecf tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:32.075325 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-891c31a1-ec6f-44d5-88b9-a3d88180cecf tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:32.211808 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-891c31a1-ec6f-44d5-88b9-a3d88180cecf tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:32.220450 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-891c31a1-ec6f-44d5-88b9-a3d88180cecf tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1265 microversion: 2.1 time: 0.161019 Jun 24 08:45:32.221511 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 245/511] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:32 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:32.481494 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-dfa072ff-fbee-4d42-acef-8682d14b8560 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:32.482104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-dfa072ff-fbee-4d42-acef-8682d14b8560 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:32.483957 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:32.489738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dfa072ff-fbee-4d42-acef-8682d14b8560 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:32.490205 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dfa072ff-fbee-4d42-acef-8682d14b8560 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:32.490965 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dfa072ff-fbee-4d42-acef-8682d14b8560 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:32.491432 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dfa072ff-fbee-4d42-acef-8682d14b8560 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:32.619392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-dfa072ff-fbee-4d42-acef-8682d14b8560 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:32.627870 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-dfa072ff-fbee-4d42-acef-8682d14b8560 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:32.629381 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-dfa072ff-fbee-4d42-acef-8682d14b8560 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:32.630551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-dfa072ff-fbee-4d42-acef-8682d14b8560 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.153005 Jun 24 08:45:32.631109 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 267/512] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:32 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:33.237684 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9c192fc9-8c97-4590-9c38-1f2f8c715602 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:33.238296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9c192fc9-8c97-4590-9c38-1f2f8c715602 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:33.244731 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c192fc9-8c97-4590-9c38-1f2f8c715602 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:33.245180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c192fc9-8c97-4590-9c38-1f2f8c715602 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:33.245941 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c192fc9-8c97-4590-9c38-1f2f8c715602 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:33.246380 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c192fc9-8c97-4590-9c38-1f2f8c715602 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:33.263751 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:33.373308 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9c192fc9-8c97-4590-9c38-1f2f8c715602 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:33.381262 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9c192fc9-8c97-4590-9c38-1f2f8c715602 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1265 microversion: 2.1 time: 0.147481 Jun 24 08:45:33.381821 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 246/513] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:33 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:33.649484 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b2a759c7-c94d-4b28-a001-6cd71038c302 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:33.650144 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b2a759c7-c94d-4b28-a001-6cd71038c302 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:33.656165 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2a759c7-c94d-4b28-a001-6cd71038c302 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:33.656614 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2a759c7-c94d-4b28-a001-6cd71038c302 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:33.657373 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2a759c7-c94d-4b28-a001-6cd71038c302 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:33.657806 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2a759c7-c94d-4b28-a001-6cd71038c302 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:33.790203 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b2a759c7-c94d-4b28-a001-6cd71038c302 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:33.798331 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b2a759c7-c94d-4b28-a001-6cd71038c302 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:33.799874 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b2a759c7-c94d-4b28-a001-6cd71038c302 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:33.801027 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b2a759c7-c94d-4b28-a001-6cd71038c302 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.155503 Jun 24 08:45:33.801584 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 268/514] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:33 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:34.397701 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-648c55ec-d352-43f5-9d42-a31d782d7e4a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:34.398337 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-648c55ec-d352-43f5-9d42-a31d782d7e4a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:34.404780 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-648c55ec-d352-43f5-9d42-a31d782d7e4a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:34.405228 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-648c55ec-d352-43f5-9d42-a31d782d7e4a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:34.406046 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-648c55ec-d352-43f5-9d42-a31d782d7e4a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:34.406481 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-648c55ec-d352-43f5-9d42-a31d782d7e4a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:34.545564 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-648c55ec-d352-43f5-9d42-a31d782d7e4a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:34.553715 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-648c55ec-d352-43f5-9d42-a31d782d7e4a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1265 microversion: 2.1 time: 0.160670 Jun 24 08:45:34.554272 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 247/515] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:34 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:34.819191 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7513d46d-2b59-44f2-9cb1-8d29204394d9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:34.819820 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7513d46d-2b59-44f2-9cb1-8d29204394d9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:34.826117 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7513d46d-2b59-44f2-9cb1-8d29204394d9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:34.826562 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7513d46d-2b59-44f2-9cb1-8d29204394d9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:34.827350 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7513d46d-2b59-44f2-9cb1-8d29204394d9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:34.827784 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7513d46d-2b59-44f2-9cb1-8d29204394d9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:34.968198 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7513d46d-2b59-44f2-9cb1-8d29204394d9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:34.988780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7513d46d-2b59-44f2-9cb1-8d29204394d9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:34.990337 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7513d46d-2b59-44f2-9cb1-8d29204394d9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:34.991568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7513d46d-2b59-44f2-9cb1-8d29204394d9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.176096 Jun 24 08:45:34.992087 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 269/516] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:34 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:35.571069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2411d5be-026d-466f-990b-76a4a8da6cba tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:35.571708 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2411d5be-026d-466f-990b-76a4a8da6cba tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:35.578059 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2411d5be-026d-466f-990b-76a4a8da6cba tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:35.578498 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2411d5be-026d-466f-990b-76a4a8da6cba tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:35.579279 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2411d5be-026d-466f-990b-76a4a8da6cba tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:35.579709 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2411d5be-026d-466f-990b-76a4a8da6cba tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:35.707152 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2411d5be-026d-466f-990b-76a4a8da6cba tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:35.714603 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2411d5be-026d-466f-990b-76a4a8da6cba tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1265 microversion: 2.1 time: 0.147389 Jun 24 08:45:35.715168 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 248/517] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:35 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:36.010560 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-828d5668-0c65-4697-b75a-b298203feb56 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:36.011115 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-828d5668-0c65-4697-b75a-b298203feb56 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:36.017029 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-828d5668-0c65-4697-b75a-b298203feb56 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:36.017462 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-828d5668-0c65-4697-b75a-b298203feb56 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:36.018854 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-828d5668-0c65-4697-b75a-b298203feb56 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:36.019311 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-828d5668-0c65-4697-b75a-b298203feb56 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:36.155417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-828d5668-0c65-4697-b75a-b298203feb56 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:36.163944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-828d5668-0c65-4697-b75a-b298203feb56 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:36.165474 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-828d5668-0c65-4697-b75a-b298203feb56 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:36.166647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-828d5668-0c65-4697-b75a-b298203feb56 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.160150 Jun 24 08:45:36.167533 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 270/518] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:36 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:36.731527 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-59fcb081-766b-4c4a-9cf6-78ab479a17e8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:36.732093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-59fcb081-766b-4c4a-9cf6-78ab479a17e8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:36.739158 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59fcb081-766b-4c4a-9cf6-78ab479a17e8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:36.739629 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59fcb081-766b-4c4a-9cf6-78ab479a17e8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:36.740388 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59fcb081-766b-4c4a-9cf6-78ab479a17e8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:36.740822 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59fcb081-766b-4c4a-9cf6-78ab479a17e8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:36.869670 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-59fcb081-766b-4c4a-9cf6-78ab479a17e8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:36.877072 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-59fcb081-766b-4c4a-9cf6-78ab479a17e8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1265 microversion: 2.1 time: 0.149488 Jun 24 08:45:36.878201 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 249/519] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:36 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:37.191860 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b667c8de-f277-4a87-99c1-752fe9614c5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:37.192472 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b667c8de-f277-4a87-99c1-752fe9614c5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:37.198335 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b667c8de-f277-4a87-99c1-752fe9614c5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:37.198783 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b667c8de-f277-4a87-99c1-752fe9614c5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:37.199573 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b667c8de-f277-4a87-99c1-752fe9614c5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:37.200007 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b667c8de-f277-4a87-99c1-752fe9614c5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:37.223722 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-b74f1be6-ba91-4e25-a5cf-8e628f463cfc req-2a347415-928e-4b7c-9108-14a6ac5a3315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7361cf5e-5979-4b93-97db-69e8a678dfa3", "name": "network-vif-plugged", "status": "completed", "tag": "4535b51a-3287-40ad-b3cf-f032fe1dd901"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:37.232321 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-b74f1be6-ba91-4e25-a5cf-8e628f463cfc req-2a347415-928e-4b7c-9108-14a6ac5a3315 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:37.232760 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-b74f1be6-ba91-4e25-a5cf-8e628f463cfc req-2a347415-928e-4b7c-9108-14a6ac5a3315 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:37.249636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-b74f1be6-ba91-4e25-a5cf-8e628f463cfc req-2a347415-928e-4b7c-9108-14a6ac5a3315 service nova] Creating event network-vif-plugged:4535b51a-3287-40ad-b3cf-f032fe1dd901 for instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 on hv-cinder-84517 Jun 24 08:45:37.255064 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-b74f1be6-ba91-4e25-a5cf-8e628f463cfc req-2a347415-928e-4b7c-9108-14a6ac5a3315 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034892 Jun 24 08:45:37.256061 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 250/520] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:45:37.339951 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b667c8de-f277-4a87-99c1-752fe9614c5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:37.349324 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b667c8de-f277-4a87-99c1-752fe9614c5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:37.351099 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b667c8de-f277-4a87-99c1-752fe9614c5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:37.352285 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b667c8de-f277-4a87-99c1-752fe9614c5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.164950 Jun 24 08:45:37.352830 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 271/521] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:37 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:37.895405 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d5f9ae8b-58f1-4d96-86d8-9143714ec23e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:37.896015 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d5f9ae8b-58f1-4d96-86d8-9143714ec23e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:37.902143 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5f9ae8b-58f1-4d96-86d8-9143714ec23e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:37.902591 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5f9ae8b-58f1-4d96-86d8-9143714ec23e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:37.903377 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5f9ae8b-58f1-4d96-86d8-9143714ec23e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:37.903813 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5f9ae8b-58f1-4d96-86d8-9143714ec23e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:38.036573 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d5f9ae8b-58f1-4d96-86d8-9143714ec23e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:38.043946 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d5f9ae8b-58f1-4d96-86d8-9143714ec23e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1265 microversion: 2.1 time: 0.153372 Jun 24 08:45:38.044775 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 251/522] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:37 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:38.370535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c3ac04df-e871-49f4-ac70-c0c405005ca0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:38.371185 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c3ac04df-e871-49f4-ac70-c0c405005ca0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:38.377281 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c3ac04df-e871-49f4-ac70-c0c405005ca0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:38.377753 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c3ac04df-e871-49f4-ac70-c0c405005ca0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:38.378549 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c3ac04df-e871-49f4-ac70-c0c405005ca0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:38.378986 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c3ac04df-e871-49f4-ac70-c0c405005ca0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:38.516366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c3ac04df-e871-49f4-ac70-c0c405005ca0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:38.524666 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c3ac04df-e871-49f4-ac70-c0c405005ca0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:38.526191 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c3ac04df-e871-49f4-ac70-c0c405005ca0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:38.527397 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c3ac04df-e871-49f4-ac70-c0c405005ca0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.160785 Jun 24 08:45:38.527951 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 272/523] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:38 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:39.060638 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7a187ac0-d884-4044-ba71-24397d301f5c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:39.061247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7a187ac0-d884-4044-ba71-24397d301f5c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:39.068197 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a187ac0-d884-4044-ba71-24397d301f5c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:39.068655 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a187ac0-d884-4044-ba71-24397d301f5c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:39.069414 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a187ac0-d884-4044-ba71-24397d301f5c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:39.069852 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7a187ac0-d884-4044-ba71-24397d301f5c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:39.200388 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7a187ac0-d884-4044-ba71-24397d301f5c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:39.208335 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7a187ac0-d884-4044-ba71-24397d301f5c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1265 microversion: 2.1 time: 0.151609 Jun 24 08:45:39.208896 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 252/524] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:39 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:39.545847 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f9faf9fb-c829-453d-a4e0-7bee9824af61 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:39.546565 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f9faf9fb-c829-453d-a4e0-7bee9824af61 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:39.552681 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9faf9fb-c829-453d-a4e0-7bee9824af61 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:39.553217 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9faf9fb-c829-453d-a4e0-7bee9824af61 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:39.554047 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9faf9fb-c829-453d-a4e0-7bee9824af61 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:39.554550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f9faf9fb-c829-453d-a4e0-7bee9824af61 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:39.686420 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f9faf9fb-c829-453d-a4e0-7bee9824af61 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:39.694736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f9faf9fb-c829-453d-a4e0-7bee9824af61 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:39.696481 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f9faf9fb-c829-453d-a4e0-7bee9824af61 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:39.697711 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f9faf9fb-c829-453d-a4e0-7bee9824af61 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.156017 Jun 24 08:45:39.704813 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 273/525] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:39 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:40.225656 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9da233a4-699f-4905-8a9d-a193672b618b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:40.226261 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9da233a4-699f-4905-8a9d-a193672b618b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:40.234008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9da233a4-699f-4905-8a9d-a193672b618b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.234462 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9da233a4-699f-4905-8a9d-a193672b618b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:40.235253 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9da233a4-699f-4905-8a9d-a193672b618b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.235810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9da233a4-699f-4905-8a9d-a193672b618b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:40.379726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9da233a4-699f-4905-8a9d-a193672b618b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:40.387579 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9da233a4-699f-4905-8a9d-a193672b618b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1452 microversion: 2.1 time: 0.166325 Jun 24 08:45:40.388178 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 253/526] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:40 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:40.404335 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-19d55600-f05d-42e7-9575-e42cf67b2199 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:40.404955 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-19d55600-f05d-42e7-9575-e42cf67b2199 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:40.411340 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-19d55600-f05d-42e7-9575-e42cf67b2199 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.411796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-19d55600-f05d-42e7-9575-e42cf67b2199 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:40.412576 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-19d55600-f05d-42e7-9575-e42cf67b2199 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.413011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-19d55600-f05d-42e7-9575-e42cf67b2199 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:40.540320 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-19d55600-f05d-42e7-9575-e42cf67b2199 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:40.547984 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-19d55600-f05d-42e7-9575-e42cf67b2199 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1452 microversion: 2.1 time: 0.147541 Jun 24 08:45:40.548577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 274/527] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:40 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:40.716113 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1f87beaf-7f3a-4b8a-b484-2113ed3e43e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:40.716722 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1f87beaf-7f3a-4b8a-b484-2113ed3e43e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:40.723230 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f87beaf-7f3a-4b8a-b484-2113ed3e43e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.723692 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f87beaf-7f3a-4b8a-b484-2113ed3e43e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:40.724454 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f87beaf-7f3a-4b8a-b484-2113ed3e43e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.724884 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1f87beaf-7f3a-4b8a-b484-2113ed3e43e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:40.925390 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1f87beaf-7f3a-4b8a-b484-2113ed3e43e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:40.933457 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1f87beaf-7f3a-4b8a-b484-2113ed3e43e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:40.934972 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1f87beaf-7f3a-4b8a-b484-2113ed3e43e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:40.936160 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1f87beaf-7f3a-4b8a-b484-2113ed3e43e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.223987 Jun 24 08:45:40.936713 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 254/528] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:40 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:41.954984 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f36a2b44-ecca-4255-8a0d-180d0202c769 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:41.956756 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f36a2b44-ecca-4255-8a0d-180d0202c769 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:41.962761 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f36a2b44-ecca-4255-8a0d-180d0202c769 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:41.963318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f36a2b44-ecca-4255-8a0d-180d0202c769 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:41.964087 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f36a2b44-ecca-4255-8a0d-180d0202c769 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:41.964562 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f36a2b44-ecca-4255-8a0d-180d0202c769 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:42.216848 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f36a2b44-ecca-4255-8a0d-180d0202c769 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:42.225085 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f36a2b44-ecca-4255-8a0d-180d0202c769 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:42.226690 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f36a2b44-ecca-4255-8a0d-180d0202c769 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:42.227965 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f36a2b44-ecca-4255-8a0d-180d0202c769 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.276847 Jun 24 08:45:42.228600 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 275/529] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:41 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:42.624910 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-39435308-abd7-4abd-afad-e954a919d6e7 req-0f29ec7f-0640-4f4a-ad45-032e0ac6c74b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7361cf5e-5979-4b93-97db-69e8a678dfa3", "tag": "4535b51a-3287-40ad-b3cf-f032fe1dd901"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:42.633681 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-39435308-abd7-4abd-afad-e954a919d6e7 req-0f29ec7f-0640-4f4a-ad45-032e0ac6c74b service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:42.634120 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-39435308-abd7-4abd-afad-e954a919d6e7 req-0f29ec7f-0640-4f4a-ad45-032e0ac6c74b service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:42.645057 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-39435308-abd7-4abd-afad-e954a919d6e7 req-0f29ec7f-0640-4f4a-ad45-032e0ac6c74b service nova] Creating event network-changed:4535b51a-3287-40ad-b3cf-f032fe1dd901 for instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 on hv-cinder-84517 Jun 24 08:45:42.649883 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-39435308-abd7-4abd-afad-e954a919d6e7 req-0f29ec7f-0640-4f4a-ad45-032e0ac6c74b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028597 Jun 24 08:45:42.650671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 255/530] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:43.245893 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b2d94920-0ebd-4c51-af19-2de7368ed52e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:43.247102 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b2d94920-0ebd-4c51-af19-2de7368ed52e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:43.253256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2d94920-0ebd-4c51-af19-2de7368ed52e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:43.253901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2d94920-0ebd-4c51-af19-2de7368ed52e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:43.254664 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2d94920-0ebd-4c51-af19-2de7368ed52e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:43.255092 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b2d94920-0ebd-4c51-af19-2de7368ed52e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:43.387423 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b2d94920-0ebd-4c51-af19-2de7368ed52e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:43.395937 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b2d94920-0ebd-4c51-af19-2de7368ed52e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:43.397438 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b2d94920-0ebd-4c51-af19-2de7368ed52e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:43.398571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b2d94920-0ebd-4c51-af19-2de7368ed52e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.156635 Jun 24 08:45:43.399117 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 276/531] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:43 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:44.417632 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f65bdb37-6e58-4763-b004-d9c39133eb7a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:44.418330 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f65bdb37-6e58-4763-b004-d9c39133eb7a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:44.425750 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f65bdb37-6e58-4763-b004-d9c39133eb7a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:44.426199 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f65bdb37-6e58-4763-b004-d9c39133eb7a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:44.426956 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f65bdb37-6e58-4763-b004-d9c39133eb7a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:44.427422 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f65bdb37-6e58-4763-b004-d9c39133eb7a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:44.557116 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f65bdb37-6e58-4763-b004-d9c39133eb7a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:44.565192 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f65bdb37-6e58-4763-b004-d9c39133eb7a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:44.566688 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f65bdb37-6e58-4763-b004-d9c39133eb7a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:44.567843 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f65bdb37-6e58-4763-b004-d9c39133eb7a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.154655 Jun 24 08:45:44.568394 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 256/532] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:44 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:45.586970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-605b6786-eebb-42da-ba7c-9afe3080bfb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:45.587607 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-605b6786-eebb-42da-ba7c-9afe3080bfb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:45.593636 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-605b6786-eebb-42da-ba7c-9afe3080bfb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:45.594077 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-605b6786-eebb-42da-ba7c-9afe3080bfb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:45.594831 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-605b6786-eebb-42da-ba7c-9afe3080bfb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:45.595283 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-605b6786-eebb-42da-ba7c-9afe3080bfb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:45.720528 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-605b6786-eebb-42da-ba7c-9afe3080bfb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:45.723932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:45.729173 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-605b6786-eebb-42da-ba7c-9afe3080bfb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:45.730672 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-605b6786-eebb-42da-ba7c-9afe3080bfb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:45.731860 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-605b6786-eebb-42da-ba7c-9afe3080bfb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.148788 Jun 24 08:45:45.732400 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 277/533] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:45 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:46.750135 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0c82df9a-c63e-466b-82c5-d99f066e8ed1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:46.750707 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0c82df9a-c63e-466b-82c5-d99f066e8ed1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:46.753050 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:46.758371 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c82df9a-c63e-466b-82c5-d99f066e8ed1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:46.758815 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c82df9a-c63e-466b-82c5-d99f066e8ed1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:46.759594 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c82df9a-c63e-466b-82c5-d99f066e8ed1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:46.760026 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0c82df9a-c63e-466b-82c5-d99f066e8ed1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:46.892510 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0c82df9a-c63e-466b-82c5-d99f066e8ed1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:46.901116 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0c82df9a-c63e-466b-82c5-d99f066e8ed1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:46.902763 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0c82df9a-c63e-466b-82c5-d99f066e8ed1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:46.904000 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0c82df9a-c63e-466b-82c5-d99f066e8ed1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1744 microversion: 2.20 time: 0.157864 Jun 24 08:45:46.904580 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 257/534] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:46 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:47.924749 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-26c11634-99e1-426a-bb1c-2edfc04e4d2d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:47.925289 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-26c11634-99e1-426a-bb1c-2edfc04e4d2d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:47.931450 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26c11634-99e1-426a-bb1c-2edfc04e4d2d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:47.931896 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26c11634-99e1-426a-bb1c-2edfc04e4d2d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:47.932679 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26c11634-99e1-426a-bb1c-2edfc04e4d2d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:47.933089 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-26c11634-99e1-426a-bb1c-2edfc04e4d2d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.058118 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-26c11634-99e1-426a-bb1c-2edfc04e4d2d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:48.065906 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-26c11634-99e1-426a-bb1c-2edfc04e4d2d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:48.067450 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-26c11634-99e1-426a-bb1c-2edfc04e4d2d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:48.068592 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-26c11634-99e1-426a-bb1c-2edfc04e4d2d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1744 microversion: 2.20 time: 0.149050 Jun 24 08:45:48.069145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 278/535] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:47 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:49.087062 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5b3a5663-2c67-408a-8407-b58e24512d3f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:49.087715 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5b3a5663-2c67-408a-8407-b58e24512d3f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:49.094220 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5b3a5663-2c67-408a-8407-b58e24512d3f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:49.094675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5b3a5663-2c67-408a-8407-b58e24512d3f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:49.095480 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5b3a5663-2c67-408a-8407-b58e24512d3f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:49.096581 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5b3a5663-2c67-408a-8407-b58e24512d3f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:49.224632 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5b3a5663-2c67-408a-8407-b58e24512d3f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:49.232439 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5b3a5663-2c67-408a-8407-b58e24512d3f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:49.233945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5b3a5663-2c67-408a-8407-b58e24512d3f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:49.235102 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5b3a5663-2c67-408a-8407-b58e24512d3f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1744 microversion: 2.20 time: 0.151917 Jun 24 08:45:49.235698 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 258/536] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:49 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:49.295306 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-abf770b6-d09c-4a48-9bad-92d48a4c613b req-831f5c6d-8b02-443b-baa4-dca66479aa0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f6b0e38-4e81-4595-9acd-ec8335bb5db5", "name": "network-vif-plugged", "status": "completed", "tag": "6c3b5569-2019-4bad-bd54-dc7ff5e8c6b1"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:49.304467 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-abf770b6-d09c-4a48-9bad-92d48a4c613b req-831f5c6d-8b02-443b-baa4-dca66479aa0e service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:49.304919 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-abf770b6-d09c-4a48-9bad-92d48a4c613b req-831f5c6d-8b02-443b-baa4-dca66479aa0e service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:49.317000 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-abf770b6-d09c-4a48-9bad-92d48a4c613b req-831f5c6d-8b02-443b-baa4-dca66479aa0e service nova] Creating event network-vif-plugged:6c3b5569-2019-4bad-bd54-dc7ff5e8c6b1 for instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 on hv-cinder-84517 Jun 24 08:45:49.321823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-abf770b6-d09c-4a48-9bad-92d48a4c613b req-831f5c6d-8b02-443b-baa4-dca66479aa0e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030531 Jun 24 08:45:49.322598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 279/537] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:50.257920 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-76b60205-5901-4997-99ee-5db944beb992 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:50.258533 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-76b60205-5901-4997-99ee-5db944beb992 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:50.265007 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76b60205-5901-4997-99ee-5db944beb992 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:50.265454 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76b60205-5901-4997-99ee-5db944beb992 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:50.266213 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76b60205-5901-4997-99ee-5db944beb992 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:50.266650 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-76b60205-5901-4997-99ee-5db944beb992 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:50.395576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-76b60205-5901-4997-99ee-5db944beb992 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:50.403379 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-76b60205-5901-4997-99ee-5db944beb992 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:50.404936 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-76b60205-5901-4997-99ee-5db944beb992 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:50.406091 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-76b60205-5901-4997-99ee-5db944beb992 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1744 microversion: 2.20 time: 0.152121 Jun 24 08:45:50.406646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 259/538] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:50 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:51.426851 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5b4ca300-7bca-47b5-b10d-79c4638e0acb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:51.427503 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5b4ca300-7bca-47b5-b10d-79c4638e0acb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:51.433717 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5b4ca300-7bca-47b5-b10d-79c4638e0acb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:51.434167 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5b4ca300-7bca-47b5-b10d-79c4638e0acb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:51.434926 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5b4ca300-7bca-47b5-b10d-79c4638e0acb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:51.435396 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5b4ca300-7bca-47b5-b10d-79c4638e0acb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:51.559326 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5b4ca300-7bca-47b5-b10d-79c4638e0acb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:51.567702 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5b4ca300-7bca-47b5-b10d-79c4638e0acb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:51.569245 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5b4ca300-7bca-47b5-b10d-79c4638e0acb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:51.570399 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5b4ca300-7bca-47b5-b10d-79c4638e0acb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1744 microversion: 2.20 time: 0.148414 Jun 24 08:45:51.571157 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 280/539] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:51 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:52.589622 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a1355cc9-c03d-462e-b8b6-fab798775b5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:52.590253 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a1355cc9-c03d-462e-b8b6-fab798775b5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:52.596727 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a1355cc9-c03d-462e-b8b6-fab798775b5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:52.597175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a1355cc9-c03d-462e-b8b6-fab798775b5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:52.597930 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a1355cc9-c03d-462e-b8b6-fab798775b5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:52.598362 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a1355cc9-c03d-462e-b8b6-fab798775b5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:52.725910 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a1355cc9-c03d-462e-b8b6-fab798775b5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:52.733740 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a1355cc9-c03d-462e-b8b6-fab798775b5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:52.735276 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a1355cc9-c03d-462e-b8b6-fab798775b5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:52.736948 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a1355cc9-c03d-462e-b8b6-fab798775b5c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1744 microversion: 2.20 time: 0.151185 Jun 24 08:45:52.737526 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 260/540] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:52 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:45:53.755436 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c77aab02-8f1b-4cac-8979-92ce7ee52cd5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:53.756303 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c77aab02-8f1b-4cac-8979-92ce7ee52cd5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:53.762278 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c77aab02-8f1b-4cac-8979-92ce7ee52cd5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:53.762741 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c77aab02-8f1b-4cac-8979-92ce7ee52cd5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:53.763534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c77aab02-8f1b-4cac-8979-92ce7ee52cd5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:53.763972 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c77aab02-8f1b-4cac-8979-92ce7ee52cd5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:53.896517 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c77aab02-8f1b-4cac-8979-92ce7ee52cd5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:53.906112 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c77aab02-8f1b-4cac-8979-92ce7ee52cd5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:53.907809 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c77aab02-8f1b-4cac-8979-92ce7ee52cd5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:53.910122 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c77aab02-8f1b-4cac-8979-92ce7ee52cd5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1739 microversion: 2.20 time: 0.159056 Jun 24 08:45:53.910685 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 281/541] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:53 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:54.929958 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e45984db-3c74-4ac7-b60d-23b9a7b39f19 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:54.931389 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e45984db-3c74-4ac7-b60d-23b9a7b39f19 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:54.938645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e45984db-3c74-4ac7-b60d-23b9a7b39f19 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:54.939389 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e45984db-3c74-4ac7-b60d-23b9a7b39f19 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:54.940597 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e45984db-3c74-4ac7-b60d-23b9a7b39f19 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:54.941264 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e45984db-3c74-4ac7-b60d-23b9a7b39f19 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:55.078386 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e45984db-3c74-4ac7-b60d-23b9a7b39f19 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:55.086523 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e45984db-3c74-4ac7-b60d-23b9a7b39f19 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:55.088064 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e45984db-3c74-4ac7-b60d-23b9a7b39f19 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:55.089201 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e45984db-3c74-4ac7-b60d-23b9a7b39f19 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1739 microversion: 2.20 time: 0.163406 Jun 24 08:45:55.100323 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 261/542] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:54 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:56.107474 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2dea1ee0-8932-4f7a-bff7-50fe2627b01a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:56.108075 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2dea1ee0-8932-4f7a-bff7-50fe2627b01a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:56.114197 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2dea1ee0-8932-4f7a-bff7-50fe2627b01a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:56.114636 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2dea1ee0-8932-4f7a-bff7-50fe2627b01a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:56.115412 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2dea1ee0-8932-4f7a-bff7-50fe2627b01a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:56.115839 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2dea1ee0-8932-4f7a-bff7-50fe2627b01a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:56.257787 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2dea1ee0-8932-4f7a-bff7-50fe2627b01a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:56.266127 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2dea1ee0-8932-4f7a-bff7-50fe2627b01a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:56.268372 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2dea1ee0-8932-4f7a-bff7-50fe2627b01a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:56.269540 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2dea1ee0-8932-4f7a-bff7-50fe2627b01a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1739 microversion: 2.20 time: 0.166103 Jun 24 08:45:56.270102 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 282/543] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:56 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:57.290554 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8b5b4387-63de-4fb5-a6b6-5f02f5ad1706 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:57.291158 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8b5b4387-63de-4fb5-a6b6-5f02f5ad1706 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:57.298384 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b5b4387-63de-4fb5-a6b6-5f02f5ad1706 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:57.299096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b5b4387-63de-4fb5-a6b6-5f02f5ad1706 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:57.299883 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b5b4387-63de-4fb5-a6b6-5f02f5ad1706 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:57.300342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b5b4387-63de-4fb5-a6b6-5f02f5ad1706 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:57.471855 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8b5b4387-63de-4fb5-a6b6-5f02f5ad1706 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:57.481988 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8b5b4387-63de-4fb5-a6b6-5f02f5ad1706 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:57.483650 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8b5b4387-63de-4fb5-a6b6-5f02f5ad1706 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:57.484962 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8b5b4387-63de-4fb5-a6b6-5f02f5ad1706 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1739 microversion: 2.20 time: 0.199269 Jun 24 08:45:57.485522 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 262/544] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:57 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:58.504642 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2659b55e-2ee6-4c09-b7b3-1cec30e99934 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:58.506069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2659b55e-2ee6-4c09-b7b3-1cec30e99934 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:58.512518 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2659b55e-2ee6-4c09-b7b3-1cec30e99934 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:58.513233 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2659b55e-2ee6-4c09-b7b3-1cec30e99934 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:58.514061 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2659b55e-2ee6-4c09-b7b3-1cec30e99934 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:58.514689 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2659b55e-2ee6-4c09-b7b3-1cec30e99934 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:58.657740 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2659b55e-2ee6-4c09-b7b3-1cec30e99934 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:58.666559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2659b55e-2ee6-4c09-b7b3-1cec30e99934 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:58.667667 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2659b55e-2ee6-4c09-b7b3-1cec30e99934 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:58.669055 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2659b55e-2ee6-4c09-b7b3-1cec30e99934 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1739 microversion: 2.20 time: 0.168390 Jun 24 08:45:58.683237 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 283/545] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:58 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:59.693581 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1e27e207-a01b-4545-996d-bd0f3000fd41 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:59.694376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1e27e207-a01b-4545-996d-bd0f3000fd41 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:59.701008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1e27e207-a01b-4545-996d-bd0f3000fd41 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:59.701461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1e27e207-a01b-4545-996d-bd0f3000fd41 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:59.702225 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1e27e207-a01b-4545-996d-bd0f3000fd41 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:59.702833 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1e27e207-a01b-4545-996d-bd0f3000fd41 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:59.854455 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1e27e207-a01b-4545-996d-bd0f3000fd41 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:59.863563 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1e27e207-a01b-4545-996d-bd0f3000fd41 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:59.865084 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1e27e207-a01b-4545-996d-bd0f3000fd41 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:59.866243 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1e27e207-a01b-4545-996d-bd0f3000fd41 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1739 microversion: 2.20 time: 0.177505 Jun 24 08:45:59.866831 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 263/546] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:59 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:00.885351 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-28868c0f-c868-47f1-89f1-04fc0f6779a6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:00.886053 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-28868c0f-c868-47f1-89f1-04fc0f6779a6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:00.887983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=42 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:00.893727 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-28868c0f-c868-47f1-89f1-04fc0f6779a6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:00.894494 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-28868c0f-c868-47f1-89f1-04fc0f6779a6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:00.895342 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-28868c0f-c868-47f1-89f1-04fc0f6779a6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:00.895800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-28868c0f-c868-47f1-89f1-04fc0f6779a6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:01.030103 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-28868c0f-c868-47f1-89f1-04fc0f6779a6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:01.038927 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-28868c0f-c868-47f1-89f1-04fc0f6779a6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:01.040697 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-28868c0f-c868-47f1-89f1-04fc0f6779a6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:01.042070 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-28868c0f-c868-47f1-89f1-04fc0f6779a6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1739 microversion: 2.20 time: 0.161152 Jun 24 08:46:01.042627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 284/547] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:00 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:02.060832 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-18a14e8a-100f-4ad8-97d7-1a1ff3c4e3dc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:02.061450 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-18a14e8a-100f-4ad8-97d7-1a1ff3c4e3dc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:02.068346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18a14e8a-100f-4ad8-97d7-1a1ff3c4e3dc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:02.068819 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18a14e8a-100f-4ad8-97d7-1a1ff3c4e3dc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:02.069593 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18a14e8a-100f-4ad8-97d7-1a1ff3c4e3dc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:02.070199 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-18a14e8a-100f-4ad8-97d7-1a1ff3c4e3dc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:02.091681 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:02.226959 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-18a14e8a-100f-4ad8-97d7-1a1ff3c4e3dc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:02.236774 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-18a14e8a-100f-4ad8-97d7-1a1ff3c4e3dc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:02.238438 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-18a14e8a-100f-4ad8-97d7-1a1ff3c4e3dc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:02.239781 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-18a14e8a-100f-4ad8-97d7-1a1ff3c4e3dc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1739 microversion: 2.20 time: 0.182886 Jun 24 08:46:02.240747 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 264/548] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:02 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:03.258023 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-87edcd4e-0cf9-4dcf-ab1f-3ac00095e8a0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:03.259474 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-87edcd4e-0cf9-4dcf-ab1f-3ac00095e8a0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:03.265712 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87edcd4e-0cf9-4dcf-ab1f-3ac00095e8a0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:03.266379 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87edcd4e-0cf9-4dcf-ab1f-3ac00095e8a0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:03.267927 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87edcd4e-0cf9-4dcf-ab1f-3ac00095e8a0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:03.268575 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87edcd4e-0cf9-4dcf-ab1f-3ac00095e8a0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:03.416395 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-87edcd4e-0cf9-4dcf-ab1f-3ac00095e8a0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:03.427249 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-87edcd4e-0cf9-4dcf-ab1f-3ac00095e8a0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:03.429752 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-87edcd4e-0cf9-4dcf-ab1f-3ac00095e8a0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:03.431066 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-87edcd4e-0cf9-4dcf-ab1f-3ac00095e8a0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1739 microversion: 2.20 time: 0.176815 Jun 24 08:46:03.442252 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 285/549] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:03 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:04.449173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-74356011-2e41-4aed-994e-5af21e620897 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:04.449779 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-74356011-2e41-4aed-994e-5af21e620897 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:04.456915 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-74356011-2e41-4aed-994e-5af21e620897 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:04.457355 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-74356011-2e41-4aed-994e-5af21e620897 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:04.458114 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-74356011-2e41-4aed-994e-5af21e620897 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:04.458549 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-74356011-2e41-4aed-994e-5af21e620897 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:04.588822 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-74356011-2e41-4aed-994e-5af21e620897 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:04.596987 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-74356011-2e41-4aed-994e-5af21e620897 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:04.598497 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-74356011-2e41-4aed-994e-5af21e620897 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:04.599678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-74356011-2e41-4aed-994e-5af21e620897 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1739 microversion: 2.20 time: 0.154485 Jun 24 08:46:04.600238 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 265/550] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:04 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:05.619032 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3b9ab27f-23fe-4939-bd20-38e39507f593 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:05.620243 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3b9ab27f-23fe-4939-bd20-38e39507f593 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:05.626532 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3b9ab27f-23fe-4939-bd20-38e39507f593 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:05.627024 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3b9ab27f-23fe-4939-bd20-38e39507f593 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:05.627820 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3b9ab27f-23fe-4939-bd20-38e39507f593 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:05.628257 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3b9ab27f-23fe-4939-bd20-38e39507f593 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:05.764492 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3b9ab27f-23fe-4939-bd20-38e39507f593 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:05.773590 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3b9ab27f-23fe-4939-bd20-38e39507f593 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:05.775015 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3b9ab27f-23fe-4939-bd20-38e39507f593 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:05.776198 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3b9ab27f-23fe-4939-bd20-38e39507f593 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1721 microversion: 2.20 time: 0.161173 Jun 24 08:46:05.788334 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 286/551] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:05 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:06.794644 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-19774d74-f4de-46ad-bbc4-53ed51a5b25c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:06.795580 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-19774d74-f4de-46ad-bbc4-53ed51a5b25c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:06.802032 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19774d74-f4de-46ad-bbc4-53ed51a5b25c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:06.802475 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19774d74-f4de-46ad-bbc4-53ed51a5b25c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:06.803242 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19774d74-f4de-46ad-bbc4-53ed51a5b25c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:06.803671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19774d74-f4de-46ad-bbc4-53ed51a5b25c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:06.934153 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-19774d74-f4de-46ad-bbc4-53ed51a5b25c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:06.943501 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-19774d74-f4de-46ad-bbc4-53ed51a5b25c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:06.944998 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-19774d74-f4de-46ad-bbc4-53ed51a5b25c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:06.946130 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-19774d74-f4de-46ad-bbc4-53ed51a5b25c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1721 microversion: 2.20 time: 0.155366 Jun 24 08:46:06.946679 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 266/552] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:06 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:07.963985 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-550b0668-8e76-4697-a966-55ef128b4a44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:07.964589 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-550b0668-8e76-4697-a966-55ef128b4a44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:07.971624 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-550b0668-8e76-4697-a966-55ef128b4a44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:07.972075 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-550b0668-8e76-4697-a966-55ef128b4a44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:07.972839 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-550b0668-8e76-4697-a966-55ef128b4a44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:07.973271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-550b0668-8e76-4697-a966-55ef128b4a44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:08.106565 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-550b0668-8e76-4697-a966-55ef128b4a44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:08.115032 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-550b0668-8e76-4697-a966-55ef128b4a44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:08.116570 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-550b0668-8e76-4697-a966-55ef128b4a44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:08.117707 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-550b0668-8e76-4697-a966-55ef128b4a44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1721 microversion: 2.20 time: 0.157608 Jun 24 08:46:08.118264 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 287/553] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:07 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:09.135734 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e9bc484e-ae7f-4c35-a331-45c0b450d0f4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:09.136349 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e9bc484e-ae7f-4c35-a331-45c0b450d0f4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:09.142764 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9bc484e-ae7f-4c35-a331-45c0b450d0f4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:09.143241 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9bc484e-ae7f-4c35-a331-45c0b450d0f4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:09.144007 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9bc484e-ae7f-4c35-a331-45c0b450d0f4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:09.144436 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e9bc484e-ae7f-4c35-a331-45c0b450d0f4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:09.268573 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e9bc484e-ae7f-4c35-a331-45c0b450d0f4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:09.276495 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e9bc484e-ae7f-4c35-a331-45c0b450d0f4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:09.278003 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e9bc484e-ae7f-4c35-a331-45c0b450d0f4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:09.279147 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e9bc484e-ae7f-4c35-a331-45c0b450d0f4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1664 microversion: 2.20 time: 0.147295 Jun 24 08:46:09.279734 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 267/554] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:09 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:46:09.297813 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9801f7c6-7f81-4809-bdef-b9ab1e6e4f9f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d71ebcdd-a8d6-42d5-8aa7-decddf585ff2"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:09.298886 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9801f7c6-7f81-4809-bdef-b9ab1e6e4f9f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:09.304954 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9801f7c6-7f81-4809-bdef-b9ab1e6e4f9f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:09.305400 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9801f7c6-7f81-4809-bdef-b9ab1e6e4f9f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:09.306160 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9801f7c6-7f81-4809-bdef-b9ab1e6e4f9f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:09.306590 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9801f7c6-7f81-4809-bdef-b9ab1e6e4f9f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:09.339117 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-3c1e80bc-4962-4c08-8d7e-283e4a2cc7a3 req-270a92fc-c27e-4f59-b5c8-08e084805108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f6b0e38-4e81-4595-9acd-ec8335bb5db5", "name": "network-vif-unplugged", "status": "completed", "tag": "6c3b5569-2019-4bad-bd54-dc7ff5e8c6b1"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:09.348072 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3c1e80bc-4962-4c08-8d7e-283e4a2cc7a3 req-270a92fc-c27e-4f59-b5c8-08e084805108 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:09.348541 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3c1e80bc-4962-4c08-8d7e-283e4a2cc7a3 req-270a92fc-c27e-4f59-b5c8-08e084805108 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:09.359623 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.compute.server_external_events [req-3c1e80bc-4962-4c08-8d7e-283e4a2cc7a3 req-270a92fc-c27e-4f59-b5c8-08e084805108 service nova] Unable to find a host for instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5. Dropping event network-vif-unplugged {{(pid=124380) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 24 08:46:09.360497 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-3c1e80bc-4962-4c08-8d7e-283e4a2cc7a3 req-270a92fc-c27e-4f59-b5c8-08e084805108 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025115 Jun 24 08:46:09.361283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 268/555] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 24 08:46:09.585851 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9801f7c6-7f81-4809-bdef-b9ab1e6e4f9f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "POST /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292092 Jun 24 08:46:09.586378 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 288/556] 10.222.0.43 () {62 vars in 1363 bytes} [Fri Jun 24 08:46:09 2022] POST /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:46:09.697354 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c7753e16-b842-4c28-93e6-3de8654d978b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:09.697934 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c7753e16-b842-4c28-93e6-3de8654d978b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:09.703826 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7753e16-b842-4c28-93e6-3de8654d978b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:09.704269 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7753e16-b842-4c28-93e6-3de8654d978b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:09.705024 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7753e16-b842-4c28-93e6-3de8654d978b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:09.705454 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7753e16-b842-4c28-93e6-3de8654d978b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:09.793170 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c7753e16-b842-4c28-93e6-3de8654d978b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "POST /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/action" status: 202 len: 0 microversion: 2.20 time: 0.099506 Jun 24 08:46:09.793824 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 269/557] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Jun 24 08:46:09 2022] POST /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:46:09.802675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-79a392fc-122a-4452-8069-26988f51dffc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:09.803332 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-79a392fc-122a-4452-8069-26988f51dffc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:09.809693 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-79a392fc-122a-4452-8069-26988f51dffc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:09.810143 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-79a392fc-122a-4452-8069-26988f51dffc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:09.810909 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-79a392fc-122a-4452-8069-26988f51dffc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:09.811379 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-79a392fc-122a-4452-8069-26988f51dffc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:09.945675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-79a392fc-122a-4452-8069-26988f51dffc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:09.954286 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-79a392fc-122a-4452-8069-26988f51dffc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:09.955870 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-79a392fc-122a-4452-8069-26988f51dffc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:09.957021 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-79a392fc-122a-4452-8069-26988f51dffc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1750 microversion: 2.20 time: 0.158799 Jun 24 08:46:09.957568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 289/558] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:09 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:10.976907 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-64e21af8-6e1b-4a2a-a018-dd3bce84f21e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:10.977657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-64e21af8-6e1b-4a2a-a018-dd3bce84f21e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:10.986975 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64e21af8-6e1b-4a2a-a018-dd3bce84f21e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:10.987556 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64e21af8-6e1b-4a2a-a018-dd3bce84f21e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:10.988354 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64e21af8-6e1b-4a2a-a018-dd3bce84f21e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:10.988790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64e21af8-6e1b-4a2a-a018-dd3bce84f21e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:11.117465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-64e21af8-6e1b-4a2a-a018-dd3bce84f21e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:11.125678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-64e21af8-6e1b-4a2a-a018-dd3bce84f21e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:11.127730 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-64e21af8-6e1b-4a2a-a018-dd3bce84f21e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:11.128880 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-64e21af8-6e1b-4a2a-a018-dd3bce84f21e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1752 microversion: 2.20 time: 0.156666 Jun 24 08:46:11.129411 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 270/559] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:10 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:12.146711 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cb9d69fe-a090-4905-96f1-0269fba4608a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:12.147347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cb9d69fe-a090-4905-96f1-0269fba4608a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:12.153323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cb9d69fe-a090-4905-96f1-0269fba4608a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:12.153766 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cb9d69fe-a090-4905-96f1-0269fba4608a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:12.154519 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cb9d69fe-a090-4905-96f1-0269fba4608a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:12.154946 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cb9d69fe-a090-4905-96f1-0269fba4608a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:12.280623 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cb9d69fe-a090-4905-96f1-0269fba4608a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:12.289083 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cb9d69fe-a090-4905-96f1-0269fba4608a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:12.290590 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cb9d69fe-a090-4905-96f1-0269fba4608a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:12.291762 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cb9d69fe-a090-4905-96f1-0269fba4608a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.148970 Jun 24 08:46:12.292317 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 290/560] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:12 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:13.324202 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-667df44d-9fad-4973-9749-f0bb237023c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:13.324915 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-667df44d-9fad-4973-9749-f0bb237023c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:13.335083 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-667df44d-9fad-4973-9749-f0bb237023c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:13.335688 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-667df44d-9fad-4973-9749-f0bb237023c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:13.337067 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-667df44d-9fad-4973-9749-f0bb237023c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:13.337595 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-667df44d-9fad-4973-9749-f0bb237023c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:13.503633 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-667df44d-9fad-4973-9749-f0bb237023c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:13.512758 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-667df44d-9fad-4973-9749-f0bb237023c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:13.514278 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-667df44d-9fad-4973-9749-f0bb237023c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:13.515469 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-667df44d-9fad-4973-9749-f0bb237023c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.203787 Jun 24 08:46:13.516111 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 271/561] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:13 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:14.535548 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-aee8e2eb-5bd3-479c-8cdd-8e11685dc0a8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:14.536122 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-aee8e2eb-5bd3-479c-8cdd-8e11685dc0a8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:14.542743 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aee8e2eb-5bd3-479c-8cdd-8e11685dc0a8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:14.543238 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aee8e2eb-5bd3-479c-8cdd-8e11685dc0a8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:14.544069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aee8e2eb-5bd3-479c-8cdd-8e11685dc0a8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:14.544523 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-aee8e2eb-5bd3-479c-8cdd-8e11685dc0a8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:14.682966 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-aee8e2eb-5bd3-479c-8cdd-8e11685dc0a8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:14.691816 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-aee8e2eb-5bd3-479c-8cdd-8e11685dc0a8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:14.693450 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-aee8e2eb-5bd3-479c-8cdd-8e11685dc0a8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:14.694650 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-aee8e2eb-5bd3-479c-8cdd-8e11685dc0a8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.164622 Jun 24 08:46:14.695306 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 291/562] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:14 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:15.713688 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-49b688b9-78cc-4146-ae52-9efc24c2a40c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:15.714296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-49b688b9-78cc-4146-ae52-9efc24c2a40c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:15.720691 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49b688b9-78cc-4146-ae52-9efc24c2a40c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:15.721138 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49b688b9-78cc-4146-ae52-9efc24c2a40c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:15.721900 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49b688b9-78cc-4146-ae52-9efc24c2a40c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:15.722331 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-49b688b9-78cc-4146-ae52-9efc24c2a40c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:15.855947 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-49b688b9-78cc-4146-ae52-9efc24c2a40c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:15.865753 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-49b688b9-78cc-4146-ae52-9efc24c2a40c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:15.867276 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-49b688b9-78cc-4146-ae52-9efc24c2a40c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:15.868435 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-49b688b9-78cc-4146-ae52-9efc24c2a40c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.158600 Jun 24 08:46:15.869179 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 272/563] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:15 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:46:16.887437 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d438556b-b01e-404b-9ffc-ba3565758486 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:16.888079 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d438556b-b01e-404b-9ffc-ba3565758486 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:16.894758 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d438556b-b01e-404b-9ffc-ba3565758486 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:16.895238 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d438556b-b01e-404b-9ffc-ba3565758486 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:16.896133 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d438556b-b01e-404b-9ffc-ba3565758486 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:16.896699 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d438556b-b01e-404b-9ffc-ba3565758486 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:16.915983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:17.034189 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d438556b-b01e-404b-9ffc-ba3565758486 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:17.043340 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d438556b-b01e-404b-9ffc-ba3565758486 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:17.045151 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d438556b-b01e-404b-9ffc-ba3565758486 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:17.046475 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d438556b-b01e-404b-9ffc-ba3565758486 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.163059 Jun 24 08:46:17.047382 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 292/564] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:16 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:18.065228 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a6884b5c-b9bb-45f9-9603-0eb683cfd5fa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:18.065996 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a6884b5c-b9bb-45f9-9603-0eb683cfd5fa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:18.068145 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=34 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:18.073251 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6884b5c-b9bb-45f9-9603-0eb683cfd5fa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:18.073735 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6884b5c-b9bb-45f9-9603-0eb683cfd5fa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:18.074503 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6884b5c-b9bb-45f9-9603-0eb683cfd5fa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:18.074933 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6884b5c-b9bb-45f9-9603-0eb683cfd5fa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:18.206693 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a6884b5c-b9bb-45f9-9603-0eb683cfd5fa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:18.226683 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a6884b5c-b9bb-45f9-9603-0eb683cfd5fa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:18.228223 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a6884b5c-b9bb-45f9-9603-0eb683cfd5fa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:18.229401 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a6884b5c-b9bb-45f9-9603-0eb683cfd5fa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.168252 Jun 24 08:46:18.229952 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 273/565] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:18 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:19.247448 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-14b31100-744c-44aa-8fe7-828cfba9e17c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:19.248076 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-14b31100-744c-44aa-8fe7-828cfba9e17c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:19.254089 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14b31100-744c-44aa-8fe7-828cfba9e17c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:19.254535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14b31100-744c-44aa-8fe7-828cfba9e17c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:19.255337 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14b31100-744c-44aa-8fe7-828cfba9e17c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:19.255771 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14b31100-744c-44aa-8fe7-828cfba9e17c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:19.388427 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-14b31100-744c-44aa-8fe7-828cfba9e17c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:19.398097 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-14b31100-744c-44aa-8fe7-828cfba9e17c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:19.399653 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-14b31100-744c-44aa-8fe7-828cfba9e17c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:19.401204 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-14b31100-744c-44aa-8fe7-828cfba9e17c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.157606 Jun 24 08:46:19.401898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 293/566] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:19 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:20.419737 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fa184a87-0f6f-422d-99cc-666ac7206dff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:20.420628 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fa184a87-0f6f-422d-99cc-666ac7206dff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:20.427748 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa184a87-0f6f-422d-99cc-666ac7206dff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:20.428194 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa184a87-0f6f-422d-99cc-666ac7206dff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:20.428955 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa184a87-0f6f-422d-99cc-666ac7206dff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:20.429390 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa184a87-0f6f-422d-99cc-666ac7206dff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:20.563016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fa184a87-0f6f-422d-99cc-666ac7206dff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:20.572806 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fa184a87-0f6f-422d-99cc-666ac7206dff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:20.574375 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fa184a87-0f6f-422d-99cc-666ac7206dff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:20.575567 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fa184a87-0f6f-422d-99cc-666ac7206dff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.159756 Jun 24 08:46:20.576129 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 274/567] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:20 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:46:21.593626 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cadedcc7-fd7d-413b-9d27-0c73e08dacb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:21.594257 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cadedcc7-fd7d-413b-9d27-0c73e08dacb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:21.601151 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cadedcc7-fd7d-413b-9d27-0c73e08dacb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:21.601596 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cadedcc7-fd7d-413b-9d27-0c73e08dacb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:21.602361 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cadedcc7-fd7d-413b-9d27-0c73e08dacb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:21.602914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cadedcc7-fd7d-413b-9d27-0c73e08dacb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:21.738056 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cadedcc7-fd7d-413b-9d27-0c73e08dacb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:21.747550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cadedcc7-fd7d-413b-9d27-0c73e08dacb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:21.749052 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cadedcc7-fd7d-413b-9d27-0c73e08dacb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:21.750209 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cadedcc7-fd7d-413b-9d27-0c73e08dacb8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.160711 Jun 24 08:46:21.750752 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 294/568] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:21 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:22.769493 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-64d1b9a1-ead4-4984-aa93-1eb2fd8efca6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:22.770148 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-64d1b9a1-ead4-4984-aa93-1eb2fd8efca6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:22.777084 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64d1b9a1-ead4-4984-aa93-1eb2fd8efca6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:22.777608 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64d1b9a1-ead4-4984-aa93-1eb2fd8efca6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:22.778440 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64d1b9a1-ead4-4984-aa93-1eb2fd8efca6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:22.778900 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-64d1b9a1-ead4-4984-aa93-1eb2fd8efca6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:22.920818 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-64d1b9a1-ead4-4984-aa93-1eb2fd8efca6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:22.929748 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-64d1b9a1-ead4-4984-aa93-1eb2fd8efca6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:22.931298 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-64d1b9a1-ead4-4984-aa93-1eb2fd8efca6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:22.932464 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-64d1b9a1-ead4-4984-aa93-1eb2fd8efca6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.166899 Jun 24 08:46:22.933128 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 275/569] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:22 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:23.951861 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c1a1fb9d-2c49-4542-be44-4885810e8c76 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:23.952474 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c1a1fb9d-2c49-4542-be44-4885810e8c76 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:23.958434 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c1a1fb9d-2c49-4542-be44-4885810e8c76 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:23.958871 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c1a1fb9d-2c49-4542-be44-4885810e8c76 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:23.959655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c1a1fb9d-2c49-4542-be44-4885810e8c76 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:23.960083 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c1a1fb9d-2c49-4542-be44-4885810e8c76 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:24.092036 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c1a1fb9d-2c49-4542-be44-4885810e8c76 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:24.101106 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c1a1fb9d-2c49-4542-be44-4885810e8c76 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:24.102614 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c1a1fb9d-2c49-4542-be44-4885810e8c76 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:24.104044 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c1a1fb9d-2c49-4542-be44-4885810e8c76 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.156078 Jun 24 08:46:24.104632 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 295/570] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:23 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:24.291837 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-260480e4-2af2-4b44-8c8a-42232172a379 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:24.292890 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-260480e4-2af2-4b44-8c8a-42232172a379 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:24.299881 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-260480e4-2af2-4b44-8c8a-42232172a379 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:24.300438 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-260480e4-2af2-4b44-8c8a-42232172a379 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:24.301175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-260480e4-2af2-4b44-8c8a-42232172a379 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:24.301637 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-260480e4-2af2-4b44-8c8a-42232172a379 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:24.380925 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-260480e4-2af2-4b44-8c8a-42232172a379 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "POST /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/action" status: 202 len: 0 microversion: 2.1 time: 0.093818 Jun 24 08:46:24.381540 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 276/571] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Jun 24 08:46:24 2022] POST /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:46:24.390391 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3f911108-0490-410f-bea3-9ec361aad631 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:24.390769 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3f911108-0490-410f-bea3-9ec361aad631 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:24.397066 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3f911108-0490-410f-bea3-9ec361aad631 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:24.397515 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3f911108-0490-410f-bea3-9ec361aad631 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:24.398292 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3f911108-0490-410f-bea3-9ec361aad631 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:24.398711 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3f911108-0490-410f-bea3-9ec361aad631 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:24.546564 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3f911108-0490-410f-bea3-9ec361aad631 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:24.555255 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3f911108-0490-410f-bea3-9ec361aad631 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1750 microversion: 2.1 time: 0.168963 Jun 24 08:46:24.557819 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 296/572] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:24 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:25.124467 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-62a9973a-a3e8-4587-8bbc-47a87d93c7af tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:25.125293 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-62a9973a-a3e8-4587-8bbc-47a87d93c7af tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:25.132168 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-62a9973a-a3e8-4587-8bbc-47a87d93c7af tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:25.132710 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-62a9973a-a3e8-4587-8bbc-47a87d93c7af tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:25.133547 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-62a9973a-a3e8-4587-8bbc-47a87d93c7af tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:25.134057 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-62a9973a-a3e8-4587-8bbc-47a87d93c7af tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:25.269607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-62a9973a-a3e8-4587-8bbc-47a87d93c7af tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:25.278204 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-62a9973a-a3e8-4587-8bbc-47a87d93c7af tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:25.279751 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-62a9973a-a3e8-4587-8bbc-47a87d93c7af tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:25.280926 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-62a9973a-a3e8-4587-8bbc-47a87d93c7af tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.160765 Jun 24 08:46:25.281515 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 277/573] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:25 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:25.572908 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-47f1f9c8-06c1-465f-9900-ab8135d88d5c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:25.573596 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-47f1f9c8-06c1-465f-9900-ab8135d88d5c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:25.580481 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-47f1f9c8-06c1-465f-9900-ab8135d88d5c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:25.580922 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-47f1f9c8-06c1-465f-9900-ab8135d88d5c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:25.581675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-47f1f9c8-06c1-465f-9900-ab8135d88d5c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:25.582100 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-47f1f9c8-06c1-465f-9900-ab8135d88d5c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:25.730300 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-47f1f9c8-06c1-465f-9900-ab8135d88d5c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:25.738818 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-47f1f9c8-06c1-465f-9900-ab8135d88d5c tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1750 microversion: 2.1 time: 0.169713 Jun 24 08:46:25.739384 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 297/574] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:25 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:26.300612 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-62c8ce6a-869b-4b3d-b23f-966acf286ce3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:26.301210 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-62c8ce6a-869b-4b3d-b23f-966acf286ce3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:26.307838 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-62c8ce6a-869b-4b3d-b23f-966acf286ce3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:26.308293 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-62c8ce6a-869b-4b3d-b23f-966acf286ce3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:26.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-62c8ce6a-869b-4b3d-b23f-966acf286ce3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:26.309491 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-62c8ce6a-869b-4b3d-b23f-966acf286ce3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:26.436635 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-62c8ce6a-869b-4b3d-b23f-966acf286ce3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:26.444889 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-62c8ce6a-869b-4b3d-b23f-966acf286ce3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:26.446389 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-62c8ce6a-869b-4b3d-b23f-966acf286ce3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:26.447582 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-62c8ce6a-869b-4b3d-b23f-966acf286ce3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.151401 Jun 24 08:46:26.448136 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 278/575] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:26 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:26.755893 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0ff0d840-433e-4c65-9922-770940fd0542 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:26.756441 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0ff0d840-433e-4c65-9922-770940fd0542 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:26.762315 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0ff0d840-433e-4c65-9922-770940fd0542 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:26.762752 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0ff0d840-433e-4c65-9922-770940fd0542 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:26.763527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0ff0d840-433e-4c65-9922-770940fd0542 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:26.763951 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0ff0d840-433e-4c65-9922-770940fd0542 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:26.899446 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0ff0d840-433e-4c65-9922-770940fd0542 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:26.907315 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0ff0d840-433e-4c65-9922-770940fd0542 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1750 microversion: 2.1 time: 0.155361 Jun 24 08:46:26.908410 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 298/576] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:26 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:27.466998 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9386de83-fdbd-470d-b907-66b14af209f1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:27.467626 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9386de83-fdbd-470d-b907-66b14af209f1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:27.474737 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9386de83-fdbd-470d-b907-66b14af209f1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:27.475188 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9386de83-fdbd-470d-b907-66b14af209f1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:27.475989 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9386de83-fdbd-470d-b907-66b14af209f1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:27.476425 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9386de83-fdbd-470d-b907-66b14af209f1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:27.608476 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9386de83-fdbd-470d-b907-66b14af209f1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:27.612555 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:27.618507 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9386de83-fdbd-470d-b907-66b14af209f1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:27.620036 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9386de83-fdbd-470d-b907-66b14af209f1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:27.621174 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9386de83-fdbd-470d-b907-66b14af209f1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.158296 Jun 24 08:46:27.621730 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 279/577] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:27 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:27.925435 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8818a4ea-8669-40b1-9c33-1cbff1238bc0 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:27.926064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8818a4ea-8669-40b1-9c33-1cbff1238bc0 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:27.932057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8818a4ea-8669-40b1-9c33-1cbff1238bc0 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:27.932503 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8818a4ea-8669-40b1-9c33-1cbff1238bc0 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:27.933253 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8818a4ea-8669-40b1-9c33-1cbff1238bc0 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:27.933682 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8818a4ea-8669-40b1-9c33-1cbff1238bc0 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:28.070722 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8818a4ea-8669-40b1-9c33-1cbff1238bc0 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:28.078592 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8818a4ea-8669-40b1-9c33-1cbff1238bc0 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1750 microversion: 2.1 time: 0.157539 Jun 24 08:46:28.079151 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 299/578] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:27 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:28.639661 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ce4b39c3-1a64-40a0-bdf7-11f3f5dda75e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:28.640265 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ce4b39c3-1a64-40a0-bdf7-11f3f5dda75e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:28.648118 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce4b39c3-1a64-40a0-bdf7-11f3f5dda75e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:28.648561 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce4b39c3-1a64-40a0-bdf7-11f3f5dda75e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:28.649317 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce4b39c3-1a64-40a0-bdf7-11f3f5dda75e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:28.649751 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ce4b39c3-1a64-40a0-bdf7-11f3f5dda75e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:28.778128 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ce4b39c3-1a64-40a0-bdf7-11f3f5dda75e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:28.786465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ce4b39c3-1a64-40a0-bdf7-11f3f5dda75e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:28.788010 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ce4b39c3-1a64-40a0-bdf7-11f3f5dda75e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:28.789149 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ce4b39c3-1a64-40a0-bdf7-11f3f5dda75e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.153540 Jun 24 08:46:28.789708 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 280/579] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:28 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:29.095939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9e593159-0c3b-4212-9181-2a16027976f8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:29.096554 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9e593159-0c3b-4212-9181-2a16027976f8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:29.102545 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e593159-0c3b-4212-9181-2a16027976f8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:29.102989 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e593159-0c3b-4212-9181-2a16027976f8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:29.103772 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e593159-0c3b-4212-9181-2a16027976f8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:29.104203 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e593159-0c3b-4212-9181-2a16027976f8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:29.242538 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9e593159-0c3b-4212-9181-2a16027976f8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:29.250392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9e593159-0c3b-4212-9181-2a16027976f8 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1750 microversion: 2.1 time: 0.158295 Jun 24 08:46:29.250945 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 300/580] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:29 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:29.808307 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-775ea85c-39e8-477a-8747-4ca17e65cec7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:29.808907 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-775ea85c-39e8-477a-8747-4ca17e65cec7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:29.815994 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-775ea85c-39e8-477a-8747-4ca17e65cec7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:29.816434 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-775ea85c-39e8-477a-8747-4ca17e65cec7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:29.817181 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-775ea85c-39e8-477a-8747-4ca17e65cec7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:29.817606 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-775ea85c-39e8-477a-8747-4ca17e65cec7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:29.941624 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-775ea85c-39e8-477a-8747-4ca17e65cec7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:29.949825 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-775ea85c-39e8-477a-8747-4ca17e65cec7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:29.951341 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-775ea85c-39e8-477a-8747-4ca17e65cec7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:29.952475 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-775ea85c-39e8-477a-8747-4ca17e65cec7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.148139 Jun 24 08:46:29.953024 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 281/581] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:29 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:30.267791 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9d815411-c05a-456c-b807-8a400c8e057d tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:30.268399 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9d815411-c05a-456c-b807-8a400c8e057d tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:30.274360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d815411-c05a-456c-b807-8a400c8e057d tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:30.274804 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d815411-c05a-456c-b807-8a400c8e057d tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:30.275773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d815411-c05a-456c-b807-8a400c8e057d tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:30.276208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9d815411-c05a-456c-b807-8a400c8e057d tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:30.416416 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9d815411-c05a-456c-b807-8a400c8e057d tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:30.425251 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9d815411-c05a-456c-b807-8a400c8e057d tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1750 microversion: 2.1 time: 0.161795 Jun 24 08:46:30.425981 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 301/582] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:30 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:30.971823 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1ea67252-ca75-4658-985b-187f0f34e8e8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:30.972548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1ea67252-ca75-4658-985b-187f0f34e8e8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:30.979011 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ea67252-ca75-4658-985b-187f0f34e8e8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:30.979492 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ea67252-ca75-4658-985b-187f0f34e8e8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:30.980255 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ea67252-ca75-4658-985b-187f0f34e8e8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:30.980689 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ea67252-ca75-4658-985b-187f0f34e8e8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:31.106776 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1ea67252-ca75-4658-985b-187f0f34e8e8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:31.115070 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1ea67252-ca75-4658-985b-187f0f34e8e8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:31.116605 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1ea67252-ca75-4658-985b-187f0f34e8e8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:31.117752 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1ea67252-ca75-4658-985b-187f0f34e8e8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.150941 Jun 24 08:46:31.118312 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 282/583] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:30 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:31.442375 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-fd75b6e1-6c20-4d61-aee3-7d8e24130d91 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:31.442981 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-fd75b6e1-6c20-4d61-aee3-7d8e24130d91 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:31.444816 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=36 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:31.450005 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fd75b6e1-6c20-4d61-aee3-7d8e24130d91 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:31.450441 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fd75b6e1-6c20-4d61-aee3-7d8e24130d91 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:31.451185 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fd75b6e1-6c20-4d61-aee3-7d8e24130d91 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:31.451638 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fd75b6e1-6c20-4d61-aee3-7d8e24130d91 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:31.591616 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-fd75b6e1-6c20-4d61-aee3-7d8e24130d91 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:31.599482 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-fd75b6e1-6c20-4d61-aee3-7d8e24130d91 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1755 microversion: 2.1 time: 0.161451 Jun 24 08:46:31.600036 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 302/584] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:31 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:32.136207 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-91870e76-e8af-4e17-abe9-824d9e29730e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:32.136822 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-91870e76-e8af-4e17-abe9-824d9e29730e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:32.143830 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91870e76-e8af-4e17-abe9-824d9e29730e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:32.144277 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91870e76-e8af-4e17-abe9-824d9e29730e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:32.145035 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91870e76-e8af-4e17-abe9-824d9e29730e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:32.145468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91870e76-e8af-4e17-abe9-824d9e29730e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:32.270425 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-91870e76-e8af-4e17-abe9-824d9e29730e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:32.278733 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-91870e76-e8af-4e17-abe9-824d9e29730e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:32.280271 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-91870e76-e8af-4e17-abe9-824d9e29730e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:32.281415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-91870e76-e8af-4e17-abe9-824d9e29730e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.149148 Jun 24 08:46:32.281965 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 283/585] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:32 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:32.617285 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7c1a3d0e-fd2d-4dcd-8b5d-0c0ef5bff992 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:32.617876 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7c1a3d0e-fd2d-4dcd-8b5d-0c0ef5bff992 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:32.623829 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7c1a3d0e-fd2d-4dcd-8b5d-0c0ef5bff992 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:32.624295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7c1a3d0e-fd2d-4dcd-8b5d-0c0ef5bff992 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:32.625042 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7c1a3d0e-fd2d-4dcd-8b5d-0c0ef5bff992 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:32.625465 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7c1a3d0e-fd2d-4dcd-8b5d-0c0ef5bff992 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:32.763523 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7c1a3d0e-fd2d-4dcd-8b5d-0c0ef5bff992 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:32.771336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7c1a3d0e-fd2d-4dcd-8b5d-0c0ef5bff992 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1755 microversion: 2.1 time: 0.157949 Jun 24 08:46:32.771888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 303/586] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:32 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:33.300326 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f5d53874-b2cd-4376-a803-9faa169a4569 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:33.300936 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f5d53874-b2cd-4376-a803-9faa169a4569 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:33.307681 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5d53874-b2cd-4376-a803-9faa169a4569 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:33.308157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5d53874-b2cd-4376-a803-9faa169a4569 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:33.308980 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5d53874-b2cd-4376-a803-9faa169a4569 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:33.309438 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f5d53874-b2cd-4376-a803-9faa169a4569 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:33.488449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f5d53874-b2cd-4376-a803-9faa169a4569 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:33.496721 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f5d53874-b2cd-4376-a803-9faa169a4569 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:33.498235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f5d53874-b2cd-4376-a803-9faa169a4569 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:33.499433 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f5d53874-b2cd-4376-a803-9faa169a4569 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.203235 Jun 24 08:46:33.500035 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 284/587] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:33 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:33.788279 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2f8c4cef-901e-46c7-889c-7f3a671e2b83 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:33.788787 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2f8c4cef-901e-46c7-889c-7f3a671e2b83 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:33.794728 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2f8c4cef-901e-46c7-889c-7f3a671e2b83 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:33.795446 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2f8c4cef-901e-46c7-889c-7f3a671e2b83 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:33.796189 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2f8c4cef-901e-46c7-889c-7f3a671e2b83 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:33.796613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2f8c4cef-901e-46c7-889c-7f3a671e2b83 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:33.999553 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2f8c4cef-901e-46c7-889c-7f3a671e2b83 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:34.007951 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2f8c4cef-901e-46c7-889c-7f3a671e2b83 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1755 microversion: 2.1 time: 0.223557 Jun 24 08:46:34.008509 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 304/588] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:33 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1755 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:34.516995 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-638af2dd-5093-4c26-bc49-8eb9f0550c60 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:34.517529 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-638af2dd-5093-4c26-bc49-8eb9f0550c60 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:34.524022 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-638af2dd-5093-4c26-bc49-8eb9f0550c60 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:34.524466 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-638af2dd-5093-4c26-bc49-8eb9f0550c60 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:34.525220 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-638af2dd-5093-4c26-bc49-8eb9f0550c60 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:34.525653 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-638af2dd-5093-4c26-bc49-8eb9f0550c60 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:34.654823 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-638af2dd-5093-4c26-bc49-8eb9f0550c60 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:34.663092 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-638af2dd-5093-4c26-bc49-8eb9f0550c60 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:34.664613 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-638af2dd-5093-4c26-bc49-8eb9f0550c60 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:34.665746 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-638af2dd-5093-4c26-bc49-8eb9f0550c60 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.152784 Jun 24 08:46:34.666303 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 285/589] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:34 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:35.025348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-09b186d0-9fb2-4b55-a9e8-070feacc3d57 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:35.025983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-09b186d0-9fb2-4b55-a9e8-070feacc3d57 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:35.031926 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09b186d0-9fb2-4b55-a9e8-070feacc3d57 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:35.032365 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09b186d0-9fb2-4b55-a9e8-070feacc3d57 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:35.033634 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09b186d0-9fb2-4b55-a9e8-070feacc3d57 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:35.034059 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09b186d0-9fb2-4b55-a9e8-070feacc3d57 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:35.170654 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-09b186d0-9fb2-4b55-a9e8-070feacc3d57 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:35.179464 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-09b186d0-9fb2-4b55-a9e8-070feacc3d57 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1755 microversion: 2.1 time: 0.157911 Jun 24 08:46:35.180029 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 305/590] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:35 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:35.684908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b3646d89-2e76-4478-a766-ad2df75000b0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:35.685516 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b3646d89-2e76-4478-a766-ad2df75000b0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:35.692579 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b3646d89-2e76-4478-a766-ad2df75000b0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:35.693022 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b3646d89-2e76-4478-a766-ad2df75000b0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:35.694038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b3646d89-2e76-4478-a766-ad2df75000b0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:35.694467 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b3646d89-2e76-4478-a766-ad2df75000b0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:35.820640 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b3646d89-2e76-4478-a766-ad2df75000b0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:35.835436 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b3646d89-2e76-4478-a766-ad2df75000b0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:35.836950 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b3646d89-2e76-4478-a766-ad2df75000b0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:35.838103 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b3646d89-2e76-4478-a766-ad2df75000b0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.157088 Jun 24 08:46:35.838680 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 286/591] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:35 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:36.196537 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c1bf6086-6cbe-4a43-9bfb-56bebabfd7bc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:36.197151 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c1bf6086-6cbe-4a43-9bfb-56bebabfd7bc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:36.203176 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c1bf6086-6cbe-4a43-9bfb-56bebabfd7bc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:36.203666 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c1bf6086-6cbe-4a43-9bfb-56bebabfd7bc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:36.204420 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c1bf6086-6cbe-4a43-9bfb-56bebabfd7bc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:36.205350 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c1bf6086-6cbe-4a43-9bfb-56bebabfd7bc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:36.340662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c1bf6086-6cbe-4a43-9bfb-56bebabfd7bc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:36.349102 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c1bf6086-6cbe-4a43-9bfb-56bebabfd7bc tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1755 microversion: 2.1 time: 0.156524 Jun 24 08:46:36.349661 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 306/592] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:36 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1755 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:36.856982 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c4c64a72-0d6e-4b53-877b-26352ed3ba8d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:36.857592 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c4c64a72-0d6e-4b53-877b-26352ed3ba8d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:36.864585 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c4c64a72-0d6e-4b53-877b-26352ed3ba8d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:36.865061 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c4c64a72-0d6e-4b53-877b-26352ed3ba8d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:36.865841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c4c64a72-0d6e-4b53-877b-26352ed3ba8d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:36.866266 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c4c64a72-0d6e-4b53-877b-26352ed3ba8d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:36.993331 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c4c64a72-0d6e-4b53-877b-26352ed3ba8d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:37.001614 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c4c64a72-0d6e-4b53-877b-26352ed3ba8d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:37.003764 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c4c64a72-0d6e-4b53-877b-26352ed3ba8d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:37.004918 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c4c64a72-0d6e-4b53-877b-26352ed3ba8d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.151838 Jun 24 08:46:37.005477 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 287/593] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:36 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:37.366504 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b5c5bde4-967b-40c7-a2d2-f474f2478438 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:37.367149 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b5c5bde4-967b-40c7-a2d2-f474f2478438 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:37.373170 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b5c5bde4-967b-40c7-a2d2-f474f2478438 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:37.373612 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b5c5bde4-967b-40c7-a2d2-f474f2478438 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:37.374388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b5c5bde4-967b-40c7-a2d2-f474f2478438 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:37.374830 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b5c5bde4-967b-40c7-a2d2-f474f2478438 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:37.521269 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b5c5bde4-967b-40c7-a2d2-f474f2478438 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:37.530119 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b5c5bde4-967b-40c7-a2d2-f474f2478438 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1755 microversion: 2.1 time: 0.167353 Jun 24 08:46:37.530902 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 307/594] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:37 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:38.024361 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7c25696f-b348-485c-88c6-c6f2cc194f1f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:38.025054 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7c25696f-b348-485c-88c6-c6f2cc194f1f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:38.031474 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c25696f-b348-485c-88c6-c6f2cc194f1f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:38.031925 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c25696f-b348-485c-88c6-c6f2cc194f1f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:38.032689 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c25696f-b348-485c-88c6-c6f2cc194f1f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:38.033126 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7c25696f-b348-485c-88c6-c6f2cc194f1f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:38.160136 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7c25696f-b348-485c-88c6-c6f2cc194f1f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:38.168515 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7c25696f-b348-485c-88c6-c6f2cc194f1f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:38.170093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7c25696f-b348-485c-88c6-c6f2cc194f1f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:38.171533 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7c25696f-b348-485c-88c6-c6f2cc194f1f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.151181 Jun 24 08:46:38.172083 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 288/595] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:38 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:46:38.549058 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d54bcc77-fec8-40a7-90c5-d233cb361253 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:38.549785 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d54bcc77-fec8-40a7-90c5-d233cb361253 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:38.555877 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d54bcc77-fec8-40a7-90c5-d233cb361253 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:38.556321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d54bcc77-fec8-40a7-90c5-d233cb361253 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:38.557075 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d54bcc77-fec8-40a7-90c5-d233cb361253 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:38.557507 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d54bcc77-fec8-40a7-90c5-d233cb361253 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:38.938636 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d54bcc77-fec8-40a7-90c5-d233cb361253 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:38.946793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d54bcc77-fec8-40a7-90c5-d233cb361253 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1755 microversion: 2.1 time: 0.402352 Jun 24 08:46:38.947411 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 308/596] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:38 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1755 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:39.189746 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-97182054-b50a-4db2-bf6e-5f654d58275f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:39.190363 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-97182054-b50a-4db2-bf6e-5f654d58275f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:39.196940 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97182054-b50a-4db2-bf6e-5f654d58275f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:39.197389 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97182054-b50a-4db2-bf6e-5f654d58275f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:39.198153 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97182054-b50a-4db2-bf6e-5f654d58275f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:39.198594 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-97182054-b50a-4db2-bf6e-5f654d58275f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:39.323355 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-97182054-b50a-4db2-bf6e-5f654d58275f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:39.332232 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-97182054-b50a-4db2-bf6e-5f654d58275f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:39.333736 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-97182054-b50a-4db2-bf6e-5f654d58275f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:39.334883 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-97182054-b50a-4db2-bf6e-5f654d58275f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.149080 Jun 24 08:46:39.335472 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 289/597] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:39 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:39.497326 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-d8c6be79-f1c6-4323-a102-9686412fc557 req-981ce32a-d02f-4b34-88a9-52d5ae77beac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f6b0e38-4e81-4595-9acd-ec8335bb5db5", "name": "network-vif-plugged", "status": "completed", "tag": "6c3b5569-2019-4bad-bd54-dc7ff5e8c6b1"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:39.506318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-d8c6be79-f1c6-4323-a102-9686412fc557 req-981ce32a-d02f-4b34-88a9-52d5ae77beac service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:39.506723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-d8c6be79-f1c6-4323-a102-9686412fc557 req-981ce32a-d02f-4b34-88a9-52d5ae77beac service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:39.511936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=100 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:39.520692 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-d8c6be79-f1c6-4323-a102-9686412fc557 req-981ce32a-d02f-4b34-88a9-52d5ae77beac service nova] Creating event network-vif-plugged:6c3b5569-2019-4bad-bd54-dc7ff5e8c6b1 for instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 on hv-cinder-84517 Jun 24 08:46:39.526036 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-d8c6be79-f1c6-4323-a102-9686412fc557 req-981ce32a-d02f-4b34-88a9-52d5ae77beac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032403 Jun 24 08:46:39.526779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 309/598] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:39.964279 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fde7a0aa-315d-44dc-8279-f6fc2992eea1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:39.964892 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fde7a0aa-315d-44dc-8279-f6fc2992eea1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:39.971978 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fde7a0aa-315d-44dc-8279-f6fc2992eea1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:39.972423 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fde7a0aa-315d-44dc-8279-f6fc2992eea1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:39.973184 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fde7a0aa-315d-44dc-8279-f6fc2992eea1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:39.973628 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fde7a0aa-315d-44dc-8279-f6fc2992eea1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:40.119047 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fde7a0aa-315d-44dc-8279-f6fc2992eea1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:40.128357 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fde7a0aa-315d-44dc-8279-f6fc2992eea1 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1755 microversion: 2.1 time: 0.167930 Jun 24 08:46:40.128974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 290/599] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:39 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:40.354388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-232257fe-0dd2-4eb8-904e-0f25a25929e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:40.355092 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-232257fe-0dd2-4eb8-904e-0f25a25929e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:40.362034 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-232257fe-0dd2-4eb8-904e-0f25a25929e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:40.362482 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-232257fe-0dd2-4eb8-904e-0f25a25929e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:40.363266 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-232257fe-0dd2-4eb8-904e-0f25a25929e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:40.363704 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-232257fe-0dd2-4eb8-904e-0f25a25929e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:40.488742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-232257fe-0dd2-4eb8-904e-0f25a25929e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:40.497145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-232257fe-0dd2-4eb8-904e-0f25a25929e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:40.498665 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-232257fe-0dd2-4eb8-904e-0f25a25929e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:40.499848 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-232257fe-0dd2-4eb8-904e-0f25a25929e0 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.149764 Jun 24 08:46:40.500399 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 310/600] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:40 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:41.146170 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d2536079-d277-48ab-af16-2825c71a22f4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:41.146780 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d2536079-d277-48ab-af16-2825c71a22f4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:41.152729 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d2536079-d277-48ab-af16-2825c71a22f4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:41.153165 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d2536079-d277-48ab-af16-2825c71a22f4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:41.153918 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d2536079-d277-48ab-af16-2825c71a22f4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:41.154347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d2536079-d277-48ab-af16-2825c71a22f4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:41.297198 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d2536079-d277-48ab-af16-2825c71a22f4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:41.305001 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d2536079-d277-48ab-af16-2825c71a22f4 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1755 microversion: 2.1 time: 0.163501 Jun 24 08:46:41.305569 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 291/601] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:41 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:41.517873 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-002ce3d1-aefe-402c-9d52-340d52fd3f40 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:41.518479 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-002ce3d1-aefe-402c-9d52-340d52fd3f40 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:41.524553 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-002ce3d1-aefe-402c-9d52-340d52fd3f40 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:41.524999 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-002ce3d1-aefe-402c-9d52-340d52fd3f40 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:41.525760 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-002ce3d1-aefe-402c-9d52-340d52fd3f40 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:41.526194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-002ce3d1-aefe-402c-9d52-340d52fd3f40 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:41.651126 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-002ce3d1-aefe-402c-9d52-340d52fd3f40 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:41.659500 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-002ce3d1-aefe-402c-9d52-340d52fd3f40 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:41.661007 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-002ce3d1-aefe-402c-9d52-340d52fd3f40 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:41.662154 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-002ce3d1-aefe-402c-9d52-340d52fd3f40 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1808 microversion: 2.20 time: 0.148224 Jun 24 08:46:41.662709 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 311/602] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:41 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:42.321832 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ad3ae965-7c64-48f1-a673-971eca4cd4ee tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:42.322548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ad3ae965-7c64-48f1-a673-971eca4cd4ee tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:42.329108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad3ae965-7c64-48f1-a673-971eca4cd4ee tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:42.329558 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad3ae965-7c64-48f1-a673-971eca4cd4ee tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:42.330825 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad3ae965-7c64-48f1-a673-971eca4cd4ee tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:42.331290 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad3ae965-7c64-48f1-a673-971eca4cd4ee tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:42.473807 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ad3ae965-7c64-48f1-a673-971eca4cd4ee tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:42.481654 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ad3ae965-7c64-48f1-a673-971eca4cd4ee tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1755 microversion: 2.1 time: 0.163726 Jun 24 08:46:42.482215 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 292/603] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:42 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:42.680758 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c7df7f17-4cb9-4bcf-8134-aac9b449e345 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:42.681368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c7df7f17-4cb9-4bcf-8134-aac9b449e345 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:42.687403 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c7df7f17-4cb9-4bcf-8134-aac9b449e345 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:42.687851 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c7df7f17-4cb9-4bcf-8134-aac9b449e345 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:42.688611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c7df7f17-4cb9-4bcf-8134-aac9b449e345 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:42.689048 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c7df7f17-4cb9-4bcf-8134-aac9b449e345 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:42.692996 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:46:42.694814 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Fri Jun 24 08:46:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 (ip 10.222.0.43) !!! Jun 24 08:46:42.820280 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c7df7f17-4cb9-4bcf-8134-aac9b449e345 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:42.828672 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c7df7f17-4cb9-4bcf-8134-aac9b449e345 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:42.830690 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c7df7f17-4cb9-4bcf-8134-aac9b449e345 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:42.831874 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c7df7f17-4cb9-4bcf-8134-aac9b449e345 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1795 microversion: 2.20 time: 0.155107 Jun 24 08:46:42.832425 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 312/604] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:46:42 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1795 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:46:43.498936 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-abf5f168-1ebd-4cf6-af87-a226a728c4a9 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:43.499476 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-abf5f168-1ebd-4cf6-af87-a226a728c4a9 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:43.506152 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-abf5f168-1ebd-4cf6-af87-a226a728c4a9 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:43.506601 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-abf5f168-1ebd-4cf6-af87-a226a728c4a9 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:43.507394 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-abf5f168-1ebd-4cf6-af87-a226a728c4a9 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:43.507857 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-abf5f168-1ebd-4cf6-af87-a226a728c4a9 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:43.645206 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-abf5f168-1ebd-4cf6-af87-a226a728c4a9 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:43.653114 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-abf5f168-1ebd-4cf6-af87-a226a728c4a9 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1755 microversion: 2.1 time: 0.158162 Jun 24 08:46:43.653708 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 293/605] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:43 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:44.671020 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-24cb5266-9e61-49a8-8c57-11d5b1f1d436 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:44.671642 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-24cb5266-9e61-49a8-8c57-11d5b1f1d436 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:44.678126 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24cb5266-9e61-49a8-8c57-11d5b1f1d436 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:44.678568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24cb5266-9e61-49a8-8c57-11d5b1f1d436 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:44.679356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24cb5266-9e61-49a8-8c57-11d5b1f1d436 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:44.679790 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24cb5266-9e61-49a8-8c57-11d5b1f1d436 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:44.820795 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-24cb5266-9e61-49a8-8c57-11d5b1f1d436 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:44.828768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-24cb5266-9e61-49a8-8c57-11d5b1f1d436 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1758 microversion: 2.1 time: 0.162013 Jun 24 08:46:44.829342 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 313/606] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:44 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:45.994247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:46:45.994798 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Fri Jun 24 08:46:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:46:54.054386 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=41 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:54.055115 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=84 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:54.156876 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7db2bb77-5e44-46c5-829b-868d6ff713f4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c275e410-8759-4006-b5b0-3fa83f01f456"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:54.158658 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7db2bb77-5e44-46c5-829b-868d6ff713f4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:54.164597 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7db2bb77-5e44-46c5-829b-868d6ff713f4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.165040 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7db2bb77-5e44-46c5-829b-868d6ff713f4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.165798 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7db2bb77-5e44-46c5-829b-868d6ff713f4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.166224 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7db2bb77-5e44-46c5-829b-868d6ff713f4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.430180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7db2bb77-5e44-46c5-829b-868d6ff713f4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "POST /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381318 Jun 24 08:46:54.430767 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 294/607] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Jun 24 08:46:54 2022] POST /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:01.900792 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4dc3b533-50ff-4644-924b-08416b23d62d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:01.901729 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4dc3b533-50ff-4644-924b-08416b23d62d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:01.903825 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=23 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:01.904475 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=24 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:01.911057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4dc3b533-50ff-4644-924b-08416b23d62d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:01.911540 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4dc3b533-50ff-4644-924b-08416b23d62d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:01.912311 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4dc3b533-50ff-4644-924b-08416b23d62d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:01.912744 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4dc3b533-50ff-4644-924b-08416b23d62d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:01.935757 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-4dc3b533-50ff-4644-924b-08416b23d62d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lazy-loading 'flavor' on Instance uuid 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:47:02.072611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4dc3b533-50ff-4644-924b-08416b23d62d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "POST /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/action" status: 200 len: 32 microversion: 2.1 time: 0.175677 Jun 24 08:47:02.073236 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 314/608] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Jun 24 08:47:01 2022] POST /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:47:02.083968 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ffe30da2-1a6d-425c-ade8-5f554a81663b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:02.084752 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ffe30da2-1a6d-425c-ade8-5f554a81663b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:02.090792 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffe30da2-1a6d-425c-ade8-5f554a81663b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:02.091265 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffe30da2-1a6d-425c-ade8-5f554a81663b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:02.092030 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffe30da2-1a6d-425c-ade8-5f554a81663b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:02.092463 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ffe30da2-1a6d-425c-ade8-5f554a81663b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:02.225760 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ffe30da2-1a6d-425c-ade8-5f554a81663b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:02.233648 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ffe30da2-1a6d-425c-ade8-5f554a81663b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.154939 Jun 24 08:47:02.234207 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 295/609] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:02 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:03.252107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6678bba5-2bbd-42bd-9a44-405505f64cd4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:03.252866 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6678bba5-2bbd-42bd-9a44-405505f64cd4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:03.259678 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6678bba5-2bbd-42bd-9a44-405505f64cd4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:03.260122 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6678bba5-2bbd-42bd-9a44-405505f64cd4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:03.260876 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6678bba5-2bbd-42bd-9a44-405505f64cd4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:03.261309 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6678bba5-2bbd-42bd-9a44-405505f64cd4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:03.389853 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6678bba5-2bbd-42bd-9a44-405505f64cd4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:03.397747 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6678bba5-2bbd-42bd-9a44-405505f64cd4 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.150007 Jun 24 08:47:03.398307 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 315/610] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:03 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:04.415172 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a332e402-483e-4ac6-b4ae-e092125f46d6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:04.415741 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a332e402-483e-4ac6-b4ae-e092125f46d6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:04.422855 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a332e402-483e-4ac6-b4ae-e092125f46d6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:04.423315 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a332e402-483e-4ac6-b4ae-e092125f46d6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:04.424067 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a332e402-483e-4ac6-b4ae-e092125f46d6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:04.424518 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a332e402-483e-4ac6-b4ae-e092125f46d6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:04.550156 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a332e402-483e-4ac6-b4ae-e092125f46d6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:04.558105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a332e402-483e-4ac6-b4ae-e092125f46d6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.146877 Jun 24 08:47:04.558672 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 296/611] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:04 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:05.575780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-621a776b-ca8c-4df9-b121-cebb5661b54a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:05.576384 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-621a776b-ca8c-4df9-b121-cebb5661b54a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:05.582926 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-621a776b-ca8c-4df9-b121-cebb5661b54a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:05.583394 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-621a776b-ca8c-4df9-b121-cebb5661b54a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:05.584145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-621a776b-ca8c-4df9-b121-cebb5661b54a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:05.584569 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-621a776b-ca8c-4df9-b121-cebb5661b54a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:05.708364 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-621a776b-ca8c-4df9-b121-cebb5661b54a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:05.716311 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-621a776b-ca8c-4df9-b121-cebb5661b54a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.144391 Jun 24 08:47:05.716877 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 316/612] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:05 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:06.733501 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-04690c16-2717-4b53-8876-adff3e2ec210 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:06.734110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-04690c16-2717-4b53-8876-adff3e2ec210 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:06.741235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04690c16-2717-4b53-8876-adff3e2ec210 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:06.741677 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04690c16-2717-4b53-8876-adff3e2ec210 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:06.742454 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04690c16-2717-4b53-8876-adff3e2ec210 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:06.742888 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-04690c16-2717-4b53-8876-adff3e2ec210 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:06.870044 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-04690c16-2717-4b53-8876-adff3e2ec210 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:06.878582 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-04690c16-2717-4b53-8876-adff3e2ec210 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.148890 Jun 24 08:47:06.879157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 297/613] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:06 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:07.895848 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-651af86f-f2d0-48c7-9ee3-8a40477fab4f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:07.896526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-651af86f-f2d0-48c7-9ee3-8a40477fab4f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:07.902304 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-651af86f-f2d0-48c7-9ee3-8a40477fab4f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:07.902753 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-651af86f-f2d0-48c7-9ee3-8a40477fab4f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:07.903530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-651af86f-f2d0-48c7-9ee3-8a40477fab4f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:07.903955 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-651af86f-f2d0-48c7-9ee3-8a40477fab4f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:08.028547 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-651af86f-f2d0-48c7-9ee3-8a40477fab4f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:08.036943 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-651af86f-f2d0-48c7-9ee3-8a40477fab4f tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.145042 Jun 24 08:47:08.037502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 317/614] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:07 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:09.054648 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-30c0dec6-7d13-4d9f-80e5-14e32562566d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:09.055394 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-30c0dec6-7d13-4d9f-80e5-14e32562566d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:09.061754 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-30c0dec6-7d13-4d9f-80e5-14e32562566d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:09.062194 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-30c0dec6-7d13-4d9f-80e5-14e32562566d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:09.062946 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-30c0dec6-7d13-4d9f-80e5-14e32562566d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:09.063403 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-30c0dec6-7d13-4d9f-80e5-14e32562566d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:09.192082 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-30c0dec6-7d13-4d9f-80e5-14e32562566d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:09.199985 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-30c0dec6-7d13-4d9f-80e5-14e32562566d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.149158 Jun 24 08:47:09.200549 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 298/615] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:09 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:10.217121 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1f2299fb-307c-49a1-a518-a45d7b83c8ad tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:10.217729 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1f2299fb-307c-49a1-a518-a45d7b83c8ad tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:10.223769 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f2299fb-307c-49a1-a518-a45d7b83c8ad tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:10.224219 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f2299fb-307c-49a1-a518-a45d7b83c8ad tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:10.224971 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f2299fb-307c-49a1-a518-a45d7b83c8ad tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:10.225401 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f2299fb-307c-49a1-a518-a45d7b83c8ad tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:10.348328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1f2299fb-307c-49a1-a518-a45d7b83c8ad tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:10.356145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1f2299fb-307c-49a1-a518-a45d7b83c8ad tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.142917 Jun 24 08:47:10.356703 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 318/616] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:10 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:11.373315 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0fa6a965-c854-45c1-b30e-68f6bad9beae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:11.373863 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0fa6a965-c854-45c1-b30e-68f6bad9beae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:11.380384 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0fa6a965-c854-45c1-b30e-68f6bad9beae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:11.380841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0fa6a965-c854-45c1-b30e-68f6bad9beae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:11.381607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0fa6a965-c854-45c1-b30e-68f6bad9beae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:11.382048 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0fa6a965-c854-45c1-b30e-68f6bad9beae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:11.509770 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0fa6a965-c854-45c1-b30e-68f6bad9beae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:11.517647 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0fa6a965-c854-45c1-b30e-68f6bad9beae tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.148350 Jun 24 08:47:11.518751 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 299/617] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:11 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:12.536210 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-94715eb5-8fbd-4a8d-8017-42b119fc68fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:12.536816 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-94715eb5-8fbd-4a8d-8017-42b119fc68fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:12.543325 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-94715eb5-8fbd-4a8d-8017-42b119fc68fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:12.543770 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-94715eb5-8fbd-4a8d-8017-42b119fc68fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:12.544525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-94715eb5-8fbd-4a8d-8017-42b119fc68fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:12.544960 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-94715eb5-8fbd-4a8d-8017-42b119fc68fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:12.669663 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-94715eb5-8fbd-4a8d-8017-42b119fc68fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:12.677750 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-94715eb5-8fbd-4a8d-8017-42b119fc68fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.146020 Jun 24 08:47:12.678299 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 319/618] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:12 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:13.695317 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-53965fa4-73fc-4c45-9f87-79be7f81532a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:13.695925 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-53965fa4-73fc-4c45-9f87-79be7f81532a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:13.702243 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53965fa4-73fc-4c45-9f87-79be7f81532a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:13.702684 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53965fa4-73fc-4c45-9f87-79be7f81532a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:13.703460 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53965fa4-73fc-4c45-9f87-79be7f81532a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:13.703901 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-53965fa4-73fc-4c45-9f87-79be7f81532a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:13.827194 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-53965fa4-73fc-4c45-9f87-79be7f81532a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:13.835521 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-53965fa4-73fc-4c45-9f87-79be7f81532a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.144038 Jun 24 08:47:13.836077 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 300/619] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:13 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:14.852858 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a19cfcfe-0774-434e-b3be-2bd4504cdcc5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:14.853470 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a19cfcfe-0774-434e-b3be-2bd4504cdcc5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:14.859502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a19cfcfe-0774-434e-b3be-2bd4504cdcc5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:14.859954 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a19cfcfe-0774-434e-b3be-2bd4504cdcc5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:14.860709 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a19cfcfe-0774-434e-b3be-2bd4504cdcc5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:14.861142 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a19cfcfe-0774-434e-b3be-2bd4504cdcc5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:14.990036 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a19cfcfe-0774-434e-b3be-2bd4504cdcc5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:14.997871 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a19cfcfe-0774-434e-b3be-2bd4504cdcc5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.148892 Jun 24 08:47:14.998423 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 320/620] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:14 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:16.014876 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9d98d6cb-e6c0-499a-932a-6ac4d26792f8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:16.015538 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9d98d6cb-e6c0-499a-932a-6ac4d26792f8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:16.022076 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9d98d6cb-e6c0-499a-932a-6ac4d26792f8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:16.022531 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9d98d6cb-e6c0-499a-932a-6ac4d26792f8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:16.023319 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9d98d6cb-e6c0-499a-932a-6ac4d26792f8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:16.023754 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9d98d6cb-e6c0-499a-932a-6ac4d26792f8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:16.147512 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9d98d6cb-e6c0-499a-932a-6ac4d26792f8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:16.155373 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9d98d6cb-e6c0-499a-932a-6ac4d26792f8 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.144347 Jun 24 08:47:16.155938 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 301/621] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:16 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:17.173384 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-baec2302-80bf-4761-b400-575df285eb4e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:17.174024 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-baec2302-80bf-4761-b400-575df285eb4e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:17.180705 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-baec2302-80bf-4761-b400-575df285eb4e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:17.181461 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-baec2302-80bf-4761-b400-575df285eb4e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:17.181882 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-baec2302-80bf-4761-b400-575df285eb4e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:17.182308 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-baec2302-80bf-4761-b400-575df285eb4e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:17.310454 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-baec2302-80bf-4761-b400-575df285eb4e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:17.318391 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-baec2302-80bf-4761-b400-575df285eb4e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.149212 Jun 24 08:47:17.318954 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 321/622] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:17 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:18.335509 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-beaa265f-2027-4919-a533-5c737108a95c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:18.336134 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-beaa265f-2027-4919-a533-5c737108a95c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:18.342497 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-beaa265f-2027-4919-a533-5c737108a95c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:18.342938 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-beaa265f-2027-4919-a533-5c737108a95c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:18.343719 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-beaa265f-2027-4919-a533-5c737108a95c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:18.344147 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-beaa265f-2027-4919-a533-5c737108a95c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:18.471871 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-beaa265f-2027-4919-a533-5c737108a95c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:18.479701 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-beaa265f-2027-4919-a533-5c737108a95c tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.148097 Jun 24 08:47:18.480262 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 302/623] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:18 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:19.497568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1f84794f-c88c-4901-8dbf-158f8ca51eab tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:19.498121 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1f84794f-c88c-4901-8dbf-158f8ca51eab tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:19.504774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f84794f-c88c-4901-8dbf-158f8ca51eab tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:19.505216 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f84794f-c88c-4901-8dbf-158f8ca51eab tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:19.505962 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f84794f-c88c-4901-8dbf-158f8ca51eab tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:19.506389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1f84794f-c88c-4901-8dbf-158f8ca51eab tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:19.632080 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1f84794f-c88c-4901-8dbf-158f8ca51eab tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:19.639956 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1f84794f-c88c-4901-8dbf-158f8ca51eab tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.146372 Jun 24 08:47:19.640512 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 322/624] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:19 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:20.657040 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a9d09cbe-c48d-42d8-9411-e99492d92b8d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:20.657674 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a9d09cbe-c48d-42d8-9411-e99492d92b8d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:20.664643 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9d09cbe-c48d-42d8-9411-e99492d92b8d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:20.665140 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9d09cbe-c48d-42d8-9411-e99492d92b8d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:20.665888 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9d09cbe-c48d-42d8-9411-e99492d92b8d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:20.666346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a9d09cbe-c48d-42d8-9411-e99492d92b8d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:20.792878 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a9d09cbe-c48d-42d8-9411-e99492d92b8d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:20.801208 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a9d09cbe-c48d-42d8-9411-e99492d92b8d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.148010 Jun 24 08:47:20.801770 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 303/625] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:20 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:21.817752 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6724f941-b731-4d03-a7e7-7b7ceab08b6e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:21.818371 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6724f941-b731-4d03-a7e7-7b7ceab08b6e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:21.824430 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6724f941-b731-4d03-a7e7-7b7ceab08b6e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:21.824869 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6724f941-b731-4d03-a7e7-7b7ceab08b6e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:21.825617 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6724f941-b731-4d03-a7e7-7b7ceab08b6e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:21.826041 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6724f941-b731-4d03-a7e7-7b7ceab08b6e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:21.949893 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6724f941-b731-4d03-a7e7-7b7ceab08b6e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:21.958344 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6724f941-b731-4d03-a7e7-7b7ceab08b6e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1733 microversion: 2.1 time: 0.144442 Jun 24 08:47:21.958903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 323/626] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:21 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:22.976262 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1ae86194-ac4f-43b1-9c74-2ffb16050d24 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:22.976875 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1ae86194-ac4f-43b1-9c74-2ffb16050d24 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:22.983295 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ae86194-ac4f-43b1-9c74-2ffb16050d24 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:22.983745 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ae86194-ac4f-43b1-9c74-2ffb16050d24 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:22.984506 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ae86194-ac4f-43b1-9c74-2ffb16050d24 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:22.984967 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1ae86194-ac4f-43b1-9c74-2ffb16050d24 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:23.114839 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1ae86194-ac4f-43b1-9c74-2ffb16050d24 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:23.122915 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1ae86194-ac4f-43b1-9c74-2ffb16050d24 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1713 microversion: 2.1 time: 0.150515 Jun 24 08:47:23.123677 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 304/627] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:22 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:23.177141 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-abf3db72-4387-490d-9cee-4e2d234ae2d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:23.177664 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-abf3db72-4387-490d-9cee-4e2d234ae2d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:23.183812 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-abf3db72-4387-490d-9cee-4e2d234ae2d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:23.184253 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-abf3db72-4387-490d-9cee-4e2d234ae2d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:23.185008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-abf3db72-4387-490d-9cee-4e2d234ae2d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:23.185432 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-abf3db72-4387-490d-9cee-4e2d234ae2d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:23.306324 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-abf3db72-4387-490d-9cee-4e2d234ae2d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] HTTP exception thrown: Cannot 'detach_volume' instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 while it is in vm_state rescued Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-abf3db72-4387-490d-9cee-4e2d234ae2d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Request method failure captured: Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-volume_attachments/c275e410-8759-4006-b5b0-3fa83f01f456 HTTP/1.1 Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXjCaDzQeeAS88pmIEoV75NGz1sj1VFNBYsQJRSIP7bTwhkvZVmMob71ZMhhz0MXKI4QBKEgB9PxOXzRd6Lsfc6ptuzcRWEP10RAhAFSAn27e_oFtPDU9vYOeHa8F7uXDn7JXFYCPp0Sf9ACgzg56ujtHpiUhbgtlC9s0ZP50y_R5v0 Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: edde4704253a4439bd7ca50b26e24e40 Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:47:23.307953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:47:23.309669 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_edde4704253a4439bd7ca50b26e24e40", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:47:23.309669 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:47:23.309669 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: edde4704253a4439bd7ca50b26e24e40 Jun 24 08:47:23.309669 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:47:23.309669 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-ServerRescueNegativeTestJSON-633414902-project Jun 24 08:47:23.309669 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:47:23.309669 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:47:23.309669 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 9abdce8004e24e81bd88bee757d8ec93 Jun 24 08:47:23.309669 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-ServerRescueNegativeTestJSON-633414902-project Jun 24 08:47:23.309669 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:47:23.309669 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Cannot 'detach_volume' instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 while it is in vm_state rescued Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'server_id': '0d9a15b4-2e8f-47c3-88f1-95b5c4755c92', 'id': 'c275e410-8759-4006-b5b0-3fa83f01f456'} Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:47:23.310505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 while it is in vm_state rescued Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 while it is in vm_state rescued Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:47:23.311862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-abf3db72-4387-490d-9cee-4e2d234ae2d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Returning 409 to user: Cannot 'detach_volume' instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 while it is in vm_state rescued {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:47:23.312918 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-abf3db72-4387-490d-9cee-4e2d234ae2d1 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-volume_attachments/c275e410-8759-4006-b5b0-3fa83f01f456" status: 409 len: 152 microversion: 2.1 time: 0.136863 Jun 24 08:47:23.312918 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 324/628] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Jun 24 08:47:23 2022] DELETE /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-volume_attachments/c275e410-8759-4006-b5b0-3fa83f01f456 => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 08:47:23.318171 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1e8ca929-b83b-4602-b2f8-317622fddf69 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:23.318706 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1e8ca929-b83b-4602-b2f8-317622fddf69 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:23.324790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1e8ca929-b83b-4602-b2f8-317622fddf69 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:23.325242 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1e8ca929-b83b-4602-b2f8-317622fddf69 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:23.326016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1e8ca929-b83b-4602-b2f8-317622fddf69 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:23.326450 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1e8ca929-b83b-4602-b2f8-317622fddf69 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:23.390819 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1e8ca929-b83b-4602-b2f8-317622fddf69 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "POST /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/action" status: 202 len: 0 microversion: 2.1 time: 0.076303 Jun 24 08:47:23.391475 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 305/629] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Jun 24 08:47:23 2022] POST /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:47:23.400720 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-14762c68-9b00-4c57-8da5-a8b2cd16a00d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:23.401330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-14762c68-9b00-4c57-8da5-a8b2cd16a00d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:23.408173 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14762c68-9b00-4c57-8da5-a8b2cd16a00d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:23.409183 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14762c68-9b00-4c57-8da5-a8b2cd16a00d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:23.409958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14762c68-9b00-4c57-8da5-a8b2cd16a00d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:23.410415 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14762c68-9b00-4c57-8da5-a8b2cd16a00d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:23.539693 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-14762c68-9b00-4c57-8da5-a8b2cd16a00d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:23.547838 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-14762c68-9b00-4c57-8da5-a8b2cd16a00d tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1721 microversion: 2.1 time: 0.151010 Jun 24 08:47:23.548396 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 325/630] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:23 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:24.566590 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-26421d09-9a98-4fde-b45b-010651e04c18 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:24.567310 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-26421d09-9a98-4fde-b45b-010651e04c18 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:24.569203 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=25 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:24.574672 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-26421d09-9a98-4fde-b45b-010651e04c18 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:24.575147 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-26421d09-9a98-4fde-b45b-010651e04c18 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:24.575966 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-26421d09-9a98-4fde-b45b-010651e04c18 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:24.576402 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-26421d09-9a98-4fde-b45b-010651e04c18 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:24.580463 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:24.707377 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-26421d09-9a98-4fde-b45b-010651e04c18 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:24.715262 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-26421d09-9a98-4fde-b45b-010651e04c18 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1721 microversion: 2.1 time: 0.153386 Jun 24 08:47:24.715823 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 306/631] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:24 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:25.733047 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b706c8ed-5234-4d79-bf54-50dd01ed69e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:25.733652 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b706c8ed-5234-4d79-bf54-50dd01ed69e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:25.740281 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b706c8ed-5234-4d79-bf54-50dd01ed69e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:25.740727 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b706c8ed-5234-4d79-bf54-50dd01ed69e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:25.741514 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b706c8ed-5234-4d79-bf54-50dd01ed69e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:25.741945 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b706c8ed-5234-4d79-bf54-50dd01ed69e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:25.867091 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b706c8ed-5234-4d79-bf54-50dd01ed69e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:25.874995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b706c8ed-5234-4d79-bf54-50dd01ed69e0 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1721 microversion: 2.1 time: 0.145808 Jun 24 08:47:25.875575 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 326/632] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:25 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:26.893496 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b72699dd-bebc-42b1-8fa7-84c9535d4f5a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:26.894149 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b72699dd-bebc-42b1-8fa7-84c9535d4f5a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:26.900672 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b72699dd-bebc-42b1-8fa7-84c9535d4f5a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:26.901120 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b72699dd-bebc-42b1-8fa7-84c9535d4f5a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:26.901873 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b72699dd-bebc-42b1-8fa7-84c9535d4f5a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:26.902300 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b72699dd-bebc-42b1-8fa7-84c9535d4f5a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:27.028270 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b72699dd-bebc-42b1-8fa7-84c9535d4f5a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:27.036091 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b72699dd-bebc-42b1-8fa7-84c9535d4f5a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1721 microversion: 2.1 time: 0.147140 Jun 24 08:47:27.036649 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 307/633] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:26 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:28.053663 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d0510c92-0085-446f-9555-b11135f0e2ec tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:28.054295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d0510c92-0085-446f-9555-b11135f0e2ec tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:28.060257 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d0510c92-0085-446f-9555-b11135f0e2ec tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.060702 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d0510c92-0085-446f-9555-b11135f0e2ec tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.061483 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d0510c92-0085-446f-9555-b11135f0e2ec tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.061913 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d0510c92-0085-446f-9555-b11135f0e2ec tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.193282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d0510c92-0085-446f-9555-b11135f0e2ec tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:28.201127 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d0510c92-0085-446f-9555-b11135f0e2ec tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1727 microversion: 2.1 time: 0.151286 Jun 24 08:47:28.201705 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 327/634] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:28 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:28.217511 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a6ccd30f-ceae-4030-b908-302f3e7b2cdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:28.218002 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a6ccd30f-ceae-4030-b908-302f3e7b2cdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:28.224839 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6ccd30f-ceae-4030-b908-302f3e7b2cdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.225281 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6ccd30f-ceae-4030-b908-302f3e7b2cdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.226035 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6ccd30f-ceae-4030-b908-302f3e7b2cdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.226459 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a6ccd30f-ceae-4030-b908-302f3e7b2cdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.301425 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a6ccd30f-ceae-4030-b908-302f3e7b2cdc tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087717 Jun 24 08:47:28.302013 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 308/635] 10.222.0.43 () {58 vars in 1274 bytes} [Fri Jun 24 08:47:28 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:29.204797 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-912087cd-2cbf-45ac-8668-5584acbbec3c req-63a8c69d-8eb6-4179-9d7c-3f951c0bb613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d9a15b4-2e8f-47c3-88f1-95b5c4755c92", "tag": "2a1e43f9-7be3-4e9c-9137-a737077baa15"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:29.213779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-912087cd-2cbf-45ac-8668-5584acbbec3c req-63a8c69d-8eb6-4179-9d7c-3f951c0bb613 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:29.214221 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-912087cd-2cbf-45ac-8668-5584acbbec3c req-63a8c69d-8eb6-4179-9d7c-3f951c0bb613 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:29.225340 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-912087cd-2cbf-45ac-8668-5584acbbec3c req-63a8c69d-8eb6-4179-9d7c-3f951c0bb613 service nova] Creating event network-changed:2a1e43f9-7be3-4e9c-9137-a737077baa15 for instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 on hv-cinder-84517 Jun 24 08:47:29.230446 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-912087cd-2cbf-45ac-8668-5584acbbec3c req-63a8c69d-8eb6-4179-9d7c-3f951c0bb613 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092211 Jun 24 08:47:29.231241 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 328/636] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:31.244955 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-f94f3296-784d-4b9a-bb82-9fa44a517cfa req-a9a28aab-4793-46f3-9a53-6257b623c504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d9a15b4-2e8f-47c3-88f1-95b5c4755c92", "tag": "2a1e43f9-7be3-4e9c-9137-a737077baa15"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:31.253565 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-f94f3296-784d-4b9a-bb82-9fa44a517cfa req-a9a28aab-4793-46f3-9a53-6257b623c504 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:31.254005 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-f94f3296-784d-4b9a-bb82-9fa44a517cfa req-a9a28aab-4793-46f3-9a53-6257b623c504 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:31.264711 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-f94f3296-784d-4b9a-bb82-9fa44a517cfa req-a9a28aab-4793-46f3-9a53-6257b623c504 service nova] Creating event network-changed:2a1e43f9-7be3-4e9c-9137-a737077baa15 for instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 on hv-cinder-84517 Jun 24 08:47:31.270205 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-f94f3296-784d-4b9a-bb82-9fa44a517cfa req-a9a28aab-4793-46f3-9a53-6257b623c504 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029480 Jun 24 08:47:31.270832 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 309/637] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:49.792464 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=30 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:49.793183 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:49.892156 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2a417d25-e818-450a-a5fe-015eff37f2b4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:49.893244 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2a417d25-e818-450a-a5fe-015eff37f2b4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:49.899454 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a417d25-e818-450a-a5fe-015eff37f2b4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:49.899900 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a417d25-e818-450a-a5fe-015eff37f2b4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:49.900658 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a417d25-e818-450a-a5fe-015eff37f2b4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:49.901090 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a417d25-e818-450a-a5fe-015eff37f2b4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:49.930672 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2a417d25-e818-450a-a5fe-015eff37f2b4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/os-volume_attachments/d71ebcdd-a8d6-42d5-8aa7-decddf585ff2" status: 200 len: 194 microversion: 2.20 time: 0.143078 Jun 24 08:47:49.931253 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 329/638] 10.222.0.43 () {60 vars in 1453 bytes} [Fri Jun 24 08:47:49 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/os-volume_attachments/d71ebcdd-a8d6-42d5-8aa7-decddf585ff2 => generated 194 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:47:49.991172 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=7 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:49.991930 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=17 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:49.996717 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-33331376-ade1-49ee-ab59-9f1023942d55 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:49.997309 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-33331376-ade1-49ee-ab59-9f1023942d55 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:50.005198 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33331376-ade1-49ee-ab59-9f1023942d55 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:50.005637 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33331376-ade1-49ee-ab59-9f1023942d55 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.006392 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33331376-ade1-49ee-ab59-9f1023942d55 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:50.006819 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-33331376-ade1-49ee-ab59-9f1023942d55 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.128573 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-33331376-ade1-49ee-ab59-9f1023942d55 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lazy-loading 'services' on Instance uuid 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:47:50.252689 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-33331376-ade1-49ee-ab59-9f1023942d55 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/os-volume_attachments/d71ebcdd-a8d6-42d5-8aa7-decddf585ff2" status: 202 len: 0 microversion: 2.20 time: 0.261942 Jun 24 08:47:50.253302 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 310/639] 10.222.0.43 () {60 vars in 1456 bytes} [Fri Jun 24 08:47:49 2022] DELETE /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/os-volume_attachments/d71ebcdd-a8d6-42d5-8aa7-decddf585ff2 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:47:50.263127 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4dc2a9ad-657d-4859-8e9b-92e1677fa1c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:50.264416 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4dc2a9ad-657d-4859-8e9b-92e1677fa1c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:50.270672 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4dc2a9ad-657d-4859-8e9b-92e1677fa1c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:50.271188 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4dc2a9ad-657d-4859-8e9b-92e1677fa1c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.271995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4dc2a9ad-657d-4859-8e9b-92e1677fa1c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:50.272535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4dc2a9ad-657d-4859-8e9b-92e1677fa1c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.301952 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4dc2a9ad-657d-4859-8e9b-92e1677fa1c8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042797 Jun 24 08:47:50.302496 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 330/640] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Jun 24 08:47:50 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:47:51.314244 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-df713f4b-3d0e-4c3d-aeeb-630f0cea989f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:51.315267 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-df713f4b-3d0e-4c3d-aeeb-630f0cea989f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:51.322378 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df713f4b-3d0e-4c3d-aeeb-630f0cea989f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:51.322821 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df713f4b-3d0e-4c3d-aeeb-630f0cea989f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:51.323607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df713f4b-3d0e-4c3d-aeeb-630f0cea989f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:51.324041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df713f4b-3d0e-4c3d-aeeb-630f0cea989f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:51.354495 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-df713f4b-3d0e-4c3d-aeeb-630f0cea989f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044532 Jun 24 08:47:51.355160 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 311/641] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Jun 24 08:47:51 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:47:52.025349 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4daa653d-dbdb-4207-91b4-f81a3ebb2790 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-654999305"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:52.025900 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4daa653d-dbdb-4207-91b4-f81a3ebb2790 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:52.031702 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4daa653d-dbdb-4207-91b4-f81a3ebb2790 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.032148 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4daa653d-dbdb-4207-91b4-f81a3ebb2790 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.032910 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4daa653d-dbdb-4207-91b4-f81a3ebb2790 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.033347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4daa653d-dbdb-4207-91b4-f81a3ebb2790 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.161022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.network.security_group_api [None req-4daa653d-dbdb-4207-91b4-f81a3ebb2790 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Removing security group 6ae25cf7-4fbe-4ecf-9d92-d13c25cc058e from port 506af44b-105c-48b6-b580-5fa177c6e0f3 Jun 24 08:47:52.366726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e4b3f442-90ee-4968-8e50-55a943af6a22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:52.367690 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e4b3f442-90ee-4968-8e50-55a943af6a22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:52.374064 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e4b3f442-90ee-4968-8e50-55a943af6a22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.374515 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e4b3f442-90ee-4968-8e50-55a943af6a22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.375300 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e4b3f442-90ee-4968-8e50-55a943af6a22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.375737 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e4b3f442-90ee-4968-8e50-55a943af6a22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.404288 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e4b3f442-90ee-4968-8e50-55a943af6a22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041556 Jun 24 08:47:52.404854 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 312/642] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Jun 24 08:47:52 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:52.465318 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5132b656-2e61-4865-be50-7b982f6c4a20 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:52.465318 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5132b656-2e61-4865-be50-7b982f6c4a20 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:52.470599 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5132b656-2e61-4865-be50-7b982f6c4a20 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.471626 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5132b656-2e61-4865-be50-7b982f6c4a20 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.472370 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5132b656-2e61-4865-be50-7b982f6c4a20 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.472795 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5132b656-2e61-4865-be50-7b982f6c4a20 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.499259 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5132b656-2e61-4865-be50-7b982f6c4a20 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:47:52.521470 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4daa653d-dbdb-4207-91b4-f81a3ebb2790 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "POST /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/action" status: 202 len: 0 microversion: 2.1 time: 0.500221 Jun 24 08:47:52.522085 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 331/643] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Jun 24 08:47:52 2022] POST /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:47:52.537709 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-457b5389-3f90-4c1c-89fd-239e628acd9a req-e55196be-a684-4702-b8d4-6c4210ea765e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9754407b-6b66-4af9-8f31-452cfbbf19e4", "tag": "506af44b-105c-48b6-b580-5fa177c6e0f3"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:52.550160 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-457b5389-3f90-4c1c-89fd-239e628acd9a req-e55196be-a684-4702-b8d4-6c4210ea765e service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.550605 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-457b5389-3f90-4c1c-89fd-239e628acd9a req-e55196be-a684-4702-b8d4-6c4210ea765e service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.576601 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-457b5389-3f90-4c1c-89fd-239e628acd9a req-e55196be-a684-4702-b8d4-6c4210ea765e service nova] Creating event network-changed:506af44b-105c-48b6-b580-5fa177c6e0f3 for instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 on hv-cinder-84517 Jun 24 08:47:52.591983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-457b5389-3f90-4c1c-89fd-239e628acd9a req-e55196be-a684-4702-b8d4-6c4210ea765e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057821 Jun 24 08:47:52.593157 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 332/644] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:47:52.620741 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5132b656-2e61-4865-be50-7b982f6c4a20 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 204 len: 0 microversion: 2.20 time: 0.160019 Jun 24 08:47:52.621330 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 313/645] 10.222.0.43 () {60 vars in 1279 bytes} [Fri Jun 24 08:47:52 2022] DELETE /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 24 08:47:52.630986 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2e5a5ef8-3a85-4cb1-8f1a-bad5d7c8c825 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:52.631792 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2e5a5ef8-3a85-4cb1-8f1a-bad5d7c8c825 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:52.643700 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2e5a5ef8-3a85-4cb1-8f1a-bad5d7c8c825 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.646041 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2e5a5ef8-3a85-4cb1-8f1a-bad5d7c8c825 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.646913 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2e5a5ef8-3a85-4cb1-8f1a-bad5d7c8c825 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.647395 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2e5a5ef8-3a85-4cb1-8f1a-bad5d7c8c825 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.857129 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2e5a5ef8-3a85-4cb1-8f1a-bad5d7c8c825 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:52.868627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2e5a5ef8-3a85-4cb1-8f1a-bad5d7c8c825 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:52.870819 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2e5a5ef8-3a85-4cb1-8f1a-bad5d7c8c825 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:52.872276 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2e5a5ef8-3a85-4cb1-8f1a-bad5d7c8c825 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.246037 Jun 24 08:47:52.873099 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 333/646] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:52 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:53.867262 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eccf692f-21c1-4b0f-9ab5-35940e061c8b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:53.867841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eccf692f-21c1-4b0f-9ab5-35940e061c8b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:53.874978 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eccf692f-21c1-4b0f-9ab5-35940e061c8b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:53.875455 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eccf692f-21c1-4b0f-9ab5-35940e061c8b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:53.876219 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eccf692f-21c1-4b0f-9ab5-35940e061c8b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:53.876648 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eccf692f-21c1-4b0f-9ab5-35940e061c8b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:53.893871 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-af48c4e0-4c82-4ca1-9cbb-15795c576d66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:53.894572 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-af48c4e0-4c82-4ca1-9cbb-15795c576d66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:53.901130 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-af48c4e0-4c82-4ca1-9cbb-15795c576d66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:53.901738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-af48c4e0-4c82-4ca1-9cbb-15795c576d66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:53.902579 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-af48c4e0-4c82-4ca1-9cbb-15795c576d66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:53.903114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-af48c4e0-4c82-4ca1-9cbb-15795c576d66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:53.966038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-eccf692f-21c1-4b0f-9ab5-35940e061c8b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lazy-loading 'services' on Instance uuid 9754407b-6b66-4af9-8f31-452cfbbf19e4 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:47:54.048526 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eccf692f-21c1-4b0f-9ab5-35940e061c8b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/os-volume_attachments/4b3d3610-bce1-4199-897b-6b53f99f6845" status: 202 len: 0 microversion: 2.1 time: 0.185457 Jun 24 08:47:54.052520 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-af48c4e0-4c82-4ca1-9cbb-15795c576d66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:54.053341 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 314/647] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Jun 24 08:47:53 2022] DELETE /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/os-volume_attachments/4b3d3610-bce1-4199-897b-6b53f99f6845 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:47:54.059579 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9c08fca1-0514-48d4-9f79-77295a0bf421 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:54.060882 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9c08fca1-0514-48d4-9f79-77295a0bf421 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:54.061899 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-af48c4e0-4c82-4ca1-9cbb-15795c576d66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:54.063557 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-af48c4e0-4c82-4ca1-9cbb-15795c576d66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:54.066732 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-af48c4e0-4c82-4ca1-9cbb-15795c576d66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.177553 Jun 24 08:47:54.067710 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 334/648] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:53 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:47:54.080277 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c08fca1-0514-48d4-9f79-77295a0bf421 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:54.081110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c08fca1-0514-48d4-9f79-77295a0bf421 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:54.081911 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c08fca1-0514-48d4-9f79-77295a0bf421 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:54.082400 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c08fca1-0514-48d4-9f79-77295a0bf421 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:54.121490 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9c08fca1-0514-48d4-9f79-77295a0bf421 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066624 Jun 24 08:47:54.122060 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 315/649] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:47:54 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:54.607682 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-5911468f-bed9-4572-b364-a6cc6873a27c req-baca9eea-fd21-46a5-9d2a-1df768710794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9754407b-6b66-4af9-8f31-452cfbbf19e4", "tag": "506af44b-105c-48b6-b580-5fa177c6e0f3"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:54.616409 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-5911468f-bed9-4572-b364-a6cc6873a27c req-baca9eea-fd21-46a5-9d2a-1df768710794 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:54.616846 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-5911468f-bed9-4572-b364-a6cc6873a27c req-baca9eea-fd21-46a5-9d2a-1df768710794 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:54.628382 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-5911468f-bed9-4572-b364-a6cc6873a27c req-baca9eea-fd21-46a5-9d2a-1df768710794 service nova] Creating event network-changed:506af44b-105c-48b6-b580-5fa177c6e0f3 for instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 on hv-cinder-84517 Jun 24 08:47:54.633358 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-5911468f-bed9-4572-b364-a6cc6873a27c req-baca9eea-fd21-46a5-9d2a-1df768710794 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029421 Jun 24 08:47:54.633938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 335/650] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:55.084685 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d4771830-40eb-4e4b-b81e-ccbddc44f78b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:55.085463 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d4771830-40eb-4e4b-b81e-ccbddc44f78b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:55.098458 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d4771830-40eb-4e4b-b81e-ccbddc44f78b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:55.098914 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d4771830-40eb-4e4b-b81e-ccbddc44f78b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:55.099831 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d4771830-40eb-4e4b-b81e-ccbddc44f78b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:55.100551 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d4771830-40eb-4e4b-b81e-ccbddc44f78b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:55.134752 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-375354c6-5c8b-471f-9bea-d5e2f069baa6 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:55.135922 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-375354c6-5c8b-471f-9bea-d5e2f069baa6 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:55.142472 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-375354c6-5c8b-471f-9bea-d5e2f069baa6 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:55.143062 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-375354c6-5c8b-471f-9bea-d5e2f069baa6 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:55.143876 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-375354c6-5c8b-471f-9bea-d5e2f069baa6 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:55.144308 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-375354c6-5c8b-471f-9bea-d5e2f069baa6 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:55.179558 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-375354c6-5c8b-471f-9bea-d5e2f069baa6 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049309 Jun 24 08:47:55.183895 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 336/651] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:47:55 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:47:55.245889 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d4771830-40eb-4e4b-b81e-ccbddc44f78b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:55.253767 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d4771830-40eb-4e4b-b81e-ccbddc44f78b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:55.255470 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d4771830-40eb-4e4b-b81e-ccbddc44f78b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:55.256632 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d4771830-40eb-4e4b-b81e-ccbddc44f78b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1723 microversion: 2.20 time: 0.175886 Jun 24 08:47:55.257189 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 316/652] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:55 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:56.192301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-617e26d9-b8eb-4c5d-8a61-6a75eb4b4e20 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:56.193511 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-617e26d9-b8eb-4c5d-8a61-6a75eb4b4e20 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:56.199631 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-617e26d9-b8eb-4c5d-8a61-6a75eb4b4e20 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:56.200078 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-617e26d9-b8eb-4c5d-8a61-6a75eb4b4e20 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:56.200848 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-617e26d9-b8eb-4c5d-8a61-6a75eb4b4e20 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:56.201296 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-617e26d9-b8eb-4c5d-8a61-6a75eb4b4e20 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:56.230850 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-617e26d9-b8eb-4c5d-8a61-6a75eb4b4e20 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043508 Jun 24 08:47:56.231733 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 337/653] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:47:56 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:47:56.241783 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2a532327-9d7f-46a3-9e16-e79364af1e26 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:56.242322 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2a532327-9d7f-46a3-9e16-e79364af1e26 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:56.249063 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2a532327-9d7f-46a3-9e16-e79364af1e26 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:56.249512 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2a532327-9d7f-46a3-9e16-e79364af1e26 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:56.250343 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2a532327-9d7f-46a3-9e16-e79364af1e26 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:56.250871 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2a532327-9d7f-46a3-9e16-e79364af1e26 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:56.276472 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-75e958fb-9e17-499b-926b-756deb48bb84 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:56.277104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-75e958fb-9e17-499b-926b-756deb48bb84 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:56.283981 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-75e958fb-9e17-499b-926b-756deb48bb84 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:56.284443 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-75e958fb-9e17-499b-926b-756deb48bb84 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:56.285245 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-75e958fb-9e17-499b-926b-756deb48bb84 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:56.285681 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-75e958fb-9e17-499b-926b-756deb48bb84 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:56.334926 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-2a532327-9d7f-46a3-9e16-e79364af1e26 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] HTTP exception thrown: Instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 is not attached to volume 4b3d3610-bce1-4199-897b-6b53f99f6845 Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2a532327-9d7f-46a3-9e16-e79364af1e26 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Request method failure captured: Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/os-volume_attachments/4b3d3610-bce1-4199-897b-6b53f99f6845 HTTP/1.1 Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXkZVfzdIgxEoiIC1CzROUq1dCWG6LtsoB6OO_0wJJp4_Pp5IjSP5E5sVffSLn4dMseuM_BXZNQoiXpzdvSJDwnrIBbnPeE6ZuYjr-mjTDjzU4c4lPxWX61qV1zEH1ZFwB9pb5bly2g6XvK2PS1R8mNed14UNN7T3YPXkHuY9pO9T0s Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: a862170421a346088ab15bc89c9a5716 Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-TestMinimumBasicScenario-1694955486 Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:47:56.342646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:47:56.344093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a862170421a346088ab15bc89c9a5716"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a862170421a346088ab15bc89c9a5716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a862170421a346088ab15bc89c9a5716", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a862170421a346088ab15bc89c9a5716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:47:56.344093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-TestMinimumBasicScenario-1694955486 Jun 24 08:47:56.344093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: a862170421a346088ab15bc89c9a5716 Jun 24 08:47:56.344093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1694955486 Jun 24 08:47:56.344093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-TestMinimumBasicScenario-1694955486-project Jun 24 08:47:56.344093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:47:56.344093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:47:56.344093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 4dbbf627f3bf4ffb87c6e23fac0b5002 Jun 24 08:47:56.344093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-TestMinimumBasicScenario-1694955486-project Jun 24 08:47:56.344093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:47:56.344093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 is not attached to volume 4b3d3610-bce1-4199-897b-6b53f99f6845 Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'server_id': '9754407b-6b66-4af9-8f31-452cfbbf19e4', 'id': '4b3d3610-bce1-4199-897b-6b53f99f6845'} Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4b3d3610-bce1-4199-897b-6b53f99f6845. Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:47:56.344811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 is not attached to volume 4b3d3610-bce1-4199-897b-6b53f99f6845 Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 is not attached to volume 4b3d3610-bce1-4199-897b-6b53f99f6845 Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:47:56.346093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2a532327-9d7f-46a3-9e16-e79364af1e26 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Returning 404 to user: Instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 is not attached to volume 4b3d3610-bce1-4199-897b-6b53f99f6845 {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:47:56.347045 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2a532327-9d7f-46a3-9e16-e79364af1e26 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/os-volume_attachments/4b3d3610-bce1-4199-897b-6b53f99f6845" status: 404 len: 154 microversion: 2.1 time: 0.106876 Jun 24 08:47:56.347045 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 317/654] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Jun 24 08:47:56 2022] DELETE /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4/os-volume_attachments/4b3d3610-bce1-4199-897b-6b53f99f6845 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:47:56.356202 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-75e958fb-9e17-499b-926b-756deb48bb84 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:56.365368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-75e958fb-9e17-499b-926b-756deb48bb84 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:56.366937 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-75e958fb-9e17-499b-926b-756deb48bb84 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:56.368125 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-75e958fb-9e17-499b-926b-756deb48bb84 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 200 len: 1656 microversion: 2.20 time: 0.096931 Jun 24 08:47:56.369299 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 338/655] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:56 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 1656 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:47:56.693478 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-430b193e-8bc2-4b4c-bdc8-72f34c8861a7 req-b8ee884e-bd6d-4a0a-a3ab-1e9e88d617ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f6b0e38-4e81-4595-9acd-ec8335bb5db5", "name": "network-vif-deleted", "tag": "6c3b5569-2019-4bad-bd54-dc7ff5e8c6b1"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:56.703987 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-430b193e-8bc2-4b4c-bdc8-72f34c8861a7 req-b8ee884e-bd6d-4a0a-a3ab-1e9e88d617ac service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:56.704423 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-430b193e-8bc2-4b4c-bdc8-72f34c8861a7 req-b8ee884e-bd6d-4a0a-a3ab-1e9e88d617ac service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:56.716011 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-430b193e-8bc2-4b4c-bdc8-72f34c8861a7 req-b8ee884e-bd6d-4a0a-a3ab-1e9e88d617ac service nova] Creating event network-vif-deleted:6c3b5569-2019-4bad-bd54-dc7ff5e8c6b1 for instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 on hv-cinder-84517 Jun 24 08:47:56.721978 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-430b193e-8bc2-4b4c-bdc8-72f34c8861a7 req-b8ee884e-bd6d-4a0a-a3ab-1e9e88d617ac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091866 Jun 24 08:47:56.722793 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 318/656] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:57.386980 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ef48418b-d98a-457e-8c6e-8f9ea71f9c22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:57.387743 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ef48418b-d98a-457e-8c6e-8f9ea71f9c22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:57.394553 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ef48418b-d98a-457e-8c6e-8f9ea71f9c22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:57.395173 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ef48418b-d98a-457e-8c6e-8f9ea71f9c22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:57.396128 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ef48418b-d98a-457e-8c6e-8f9ea71f9c22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:57.396716 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ef48418b-d98a-457e-8c6e-8f9ea71f9c22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:57.411652 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-ef48418b-d98a-457e-8c6e-8f9ea71f9c22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] HTTP exception thrown: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ef48418b-d98a-457e-8c6e-8f9ea71f9c22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Request method failure captured: Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 HTTP/1.1 Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXjISBaZPnLTRFWfDFBrNoJb_9l8PMROGS9TZHCKbXDNj_v5GPbS_LWzfSeyv8QrRiiJ2p0EhwSb565cLn9CUiAAw9FDInOycXWZZ7kByah1En8fBZRCCnz_I_mA9HYiRd0eYq-Z9liDIEUACwUbJN36719ofSomjnY6gjuP30-gqB8 Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 150883a8e55c459a9f41fc48f8f81b0c Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:47:57.413293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:47:57.414907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_150883a8e55c459a9f41fc48f8f81b0c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:47:57.414907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:47:57.414907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 150883a8e55c459a9f41fc48f8f81b0c Jun 24 08:47:57.414907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:47:57.414907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeShelveTestJSON-779659428-project Jun 24 08:47:57.414907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:47:57.414907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:47:57.414907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 12f0ce0a293f4114a90098985e5f21ee Jun 24 08:47:57.414907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeShelveTestJSON-779659428-project Jun 24 08:47:57.414907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:47:57.414907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:47:57.414907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '8f6b0e38-4e81-4595-9acd-ec8335bb5db5'} Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:47:57.415917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:47:57.417240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:47:57.418389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ef48418b-d98a-457e-8c6e-8f9ea71f9c22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Returning 404 to user: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:47:57.418389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ef48418b-d98a-457e-8c6e-8f9ea71f9c22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 404 len: 111 microversion: 2.20 time: 0.031681 Jun 24 08:47:57.418389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 339/657] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:47:57 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:47:57.424978 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-00eda227-de48-4727-8bc4-c5a69b428679 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '.version_select at 0x7fb75c947d30>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:57.447467 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-00eda227-de48-4727-8bc4-c5a69b428679 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692042545" status: 204 len: 0 microversion: 2.20 time: 0.027233 Jun 24 08:47:57.448181 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 319/658] 10.222.0.43 () {60 vars in 1261 bytes} [Fri Jun 24 08:47:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692042545 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 08:47:57.493172 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e56c9b04-3a47-4ebb-bb5f-b587a78e8d85 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:57.493910 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e56c9b04-3a47-4ebb-bb5f-b587a78e8d85 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:57.500837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e56c9b04-3a47-4ebb-bb5f-b587a78e8d85 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:57.502141 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e56c9b04-3a47-4ebb-bb5f-b587a78e8d85 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:57.503231 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e56c9b04-3a47-4ebb-bb5f-b587a78e8d85 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:57.503821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e56c9b04-3a47-4ebb-bb5f-b587a78e8d85 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:57.540314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e56c9b04-3a47-4ebb-bb5f-b587a78e8d85 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:47:57.637843 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e56c9b04-3a47-4ebb-bb5f-b587a78e8d85 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 204 len: 0 microversion: 2.1 time: 0.148815 Jun 24 08:47:57.641900 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 340/659] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:47:57 2022] DELETE /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:47:57.646999 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d9eb8591-6cec-404e-a635-a0d6ccd73d6b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:57.647779 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d9eb8591-6cec-404e-a635-a0d6ccd73d6b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:57.655073 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9eb8591-6cec-404e-a635-a0d6ccd73d6b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:57.655549 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9eb8591-6cec-404e-a635-a0d6ccd73d6b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:57.656324 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9eb8591-6cec-404e-a635-a0d6ccd73d6b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:57.656756 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d9eb8591-6cec-404e-a635-a0d6ccd73d6b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:57.948548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d9eb8591-6cec-404e-a635-a0d6ccd73d6b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:57.956538 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d9eb8591-6cec-404e-a635-a0d6ccd73d6b tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1553 microversion: 2.1 time: 0.313354 Jun 24 08:47:57.957104 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 320/660] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:57 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1553 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:58.252227 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b83e60b4-f76d-4186-8817-45a2933b4f1a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Action: 'create', calling method: .version_select at 0x7fb75c8f0940>, body: {"keypair": {"name": "tempest-keypair-107141842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKq1Lcrapyyh/ayOyVh7tNyGlV5wIFYH+ILNy5MixJjzYNfISSAHPGLWBNfzUUcjsJi3MdURut8Kz7KLY+Eyo4ResBR3gUxv4CKZYaaPWfATdo12DnviqYvydqiygOGX7Q=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:58.266556 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-b83e60b4-f76d-4186-8817-45a2933b4f1a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Getting quotas for project 150883a8e55c459a9f41fc48f8f81b0c. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:47:58.271569 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-b83e60b4-f76d-4186-8817-45a2933b4f1a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Getting quotas for user 12f0ce0a293f4114a90098985e5f21ee and project 150883a8e55c459a9f41fc48f8f81b0c. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:47:58.295353 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b83e60b4-f76d-4186-8817-45a2933b4f1a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047505 Jun 24 08:47:58.295953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 341/661] 10.222.0.43 () {62 vars in 1199 bytes} [Fri Jun 24 08:47:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 24 08:47:58.972759 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-60fd6777-7cd6-4b3f-a6cf-831f731839ca tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:58.973491 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-60fd6777-7cd6-4b3f-a6cf-831f731839ca tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:58.980105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60fd6777-7cd6-4b3f-a6cf-831f731839ca tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:58.980557 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60fd6777-7cd6-4b3f-a6cf-831f731839ca tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:58.981320 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60fd6777-7cd6-4b3f-a6cf-831f731839ca tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:58.981755 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-60fd6777-7cd6-4b3f-a6cf-831f731839ca tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:59.120207 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-60fd6777-7cd6-4b3f-a6cf-831f731839ca tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:59.128639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-60fd6777-7cd6-4b3f-a6cf-831f731839ca tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1553 microversion: 2.1 time: 0.159686 Jun 24 08:47:59.138290 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 321/662] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:58 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:59.529555 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1231692142", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "679fe362-1384-4e2b-bdfd-6758eea022f3"}], "security_groups": [{"name": "tempest-securitygroup--78274872"}], "key_name": "tempest-keypair-107141842", "user_data": "}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:59.632529 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] validate_networks() for [('679fe362-1384-4e2b-bdfd-6758eea022f3', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:48:00.060108 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:48:00.060524 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:48:00.061017 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:48:00.061416 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:48:00.061815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:48:00.070489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:00.070932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:00.071746 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:00.072171 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:00.100984 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Getting quotas for project 150883a8e55c459a9f41fc48f8f81b0c. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:48:00.105417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Getting quotas for user 12f0ce0a293f4114a90098985e5f21ee and project 150883a8e55c459a9f41fc48f8f81b0c. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:48:00.117660 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:48:00.120044 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:48:00.146584 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fdd7aa71-cc1a-42e8-a394-be363127a1fa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:00.147363 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fdd7aa71-cc1a-42e8-a394-be363127a1fa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:00.154812 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fdd7aa71-cc1a-42e8-a394-be363127a1fa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:00.155420 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fdd7aa71-cc1a-42e8-a394-be363127a1fa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:00.156341 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fdd7aa71-cc1a-42e8-a394-be363127a1fa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:00.157020 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fdd7aa71-cc1a-42e8-a394-be363127a1fa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:00.179876 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7029e2e3-b041-432f-a834-d9077ad6d9b1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.654578 Jun 24 08:48:00.192192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 342/663] 10.222.0.43 () {62 vars in 1187 bytes} [Fri Jun 24 08:47:59 2022] POST /compute/v2.1/servers => generated 400 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 08:48:00.192627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-dc7f0468-99d1-4e44-a628-1a2c6dbed7c5 req-53e86729-ecee-4738-9bd3-7bb4293a268f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9754407b-6b66-4af9-8f31-452cfbbf19e4", "name": "network-vif-deleted", "tag": "506af44b-105c-48b6-b580-5fa177c6e0f3"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:00.211610 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-dc7f0468-99d1-4e44-a628-1a2c6dbed7c5 req-53e86729-ecee-4738-9bd3-7bb4293a268f service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:00.212139 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-dc7f0468-99d1-4e44-a628-1a2c6dbed7c5 req-53e86729-ecee-4738-9bd3-7bb4293a268f service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:00.223154 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-dc7f0468-99d1-4e44-a628-1a2c6dbed7c5 req-53e86729-ecee-4738-9bd3-7bb4293a268f service nova] Creating event network-vif-deleted:506af44b-105c-48b6-b580-5fa177c6e0f3 for instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 on hv-cinder-84517 Jun 24 08:48:00.229282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-dc7f0468-99d1-4e44-a628-1a2c6dbed7c5 req-53e86729-ecee-4738-9bd3-7bb4293a268f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039655 Jun 24 08:48:00.229426 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 343/664] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:00.231036 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fdd7aa71-cc1a-42e8-a394-be363127a1fa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbbf627f3bf4ffb87c6e23fac0b5002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a862170421a346088ab15bc89c9a5716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:00.239334 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c66e1efa-efd5-46d9-884d-beed24c337f9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:00.239507 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fdd7aa71-cc1a-42e8-a394-be363127a1fa tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 200 len: 1511 microversion: 2.1 time: 0.097913 Jun 24 08:48:00.240044 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c66e1efa-efd5-46d9-884d-beed24c337f9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:00.240161 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 322/665] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:00 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 1511 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:00.295800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c66e1efa-efd5-46d9-884d-beed24c337f9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:00.303854 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c66e1efa-efd5-46d9-884d-beed24c337f9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:00.305362 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c66e1efa-efd5-46d9-884d-beed24c337f9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:00.306433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c66e1efa-efd5-46d9-884d-beed24c337f9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1281 microversion: 2.20 time: 0.072536 Jun 24 08:48:00.306978 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 344/666] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:00 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:00.616288 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d8bd0f2b-4244-4658-897c-432fca576981 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:00.616827 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d8bd0f2b-4244-4658-897c-432fca576981 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:00.622897 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8bd0f2b-4244-4658-897c-432fca576981 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:00.623386 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8bd0f2b-4244-4658-897c-432fca576981 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:00.624157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8bd0f2b-4244-4658-897c-432fca576981 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:00.624594 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d8bd0f2b-4244-4658-897c-432fca576981 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:00.648097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-d8bd0f2b-4244-4658-897c-432fca576981 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lazy-loading 'flavor' on Instance uuid 73106291-ded8-47c4-8b9f-6ee2c7fe3926 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:48:00.695997 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:00.722741 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d8bd0f2b-4244-4658-897c-432fca576981 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "POST /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926/action" status: 202 len: 0 microversion: 2.1 time: 0.110355 Jun 24 08:48:00.723353 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 323/667] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Jun 24 08:48:00 2022] POST /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:48:00.731529 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5c2037d0-c5ad-428a-981b-022296d8e30e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:00.732164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5c2037d0-c5ad-428a-981b-022296d8e30e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:00.738411 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5c2037d0-c5ad-428a-981b-022296d8e30e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:00.738887 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5c2037d0-c5ad-428a-981b-022296d8e30e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:00.739748 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5c2037d0-c5ad-428a-981b-022296d8e30e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:00.740183 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5c2037d0-c5ad-428a-981b-022296d8e30e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:00.872492 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5c2037d0-c5ad-428a-981b-022296d8e30e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:00.881119 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5c2037d0-c5ad-428a-981b-022296d8e30e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1566 microversion: 2.1 time: 0.153536 Jun 24 08:48:00.881702 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 345/668] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:00 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:01.257184 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c91be0c4-9360-471f-bc9d-7a71db215a81 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:01.257882 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c91be0c4-9360-471f-bc9d-7a71db215a81 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] [instance: 9754407b-6b66-4af9-8f31-452cfbbf19e4] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:01.264133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c91be0c4-9360-471f-bc9d-7a71db215a81 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:01.264584 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c91be0c4-9360-471f-bc9d-7a71db215a81 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:01.265346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c91be0c4-9360-471f-bc9d-7a71db215a81 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:01.265781 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c91be0c4-9360-471f-bc9d-7a71db215a81 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:01.278814 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-c91be0c4-9360-471f-bc9d-7a71db215a81 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] HTTP exception thrown: Instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 could not be found. Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c91be0c4-9360-471f-bc9d-7a71db215a81 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Request method failure captured: Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 HTTP/1.1 Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXkZVfzdIgxEoiIC1CzROUq1dCWG6LtsoB6OO_0wJJp4_Pp5IjSP5E5sVffSLn4dMseuM_BXZNQoiXpzdvSJDwnrIBbnPeE6ZuYjr-mjTDjzU4c4lPxWX61qV1zEH1ZFwB9pb5bly2g6XvK2PS1R8mNed14UNN7T3YPXkHuY9pO9T0s Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: a862170421a346088ab15bc89c9a5716 Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-TestMinimumBasicScenario-1694955486 Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:48:01.280461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:48:01.282105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a862170421a346088ab15bc89c9a5716"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a862170421a346088ab15bc89c9a5716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a862170421a346088ab15bc89c9a5716", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a862170421a346088ab15bc89c9a5716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:48:01.282105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-TestMinimumBasicScenario-1694955486 Jun 24 08:48:01.282105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: a862170421a346088ab15bc89c9a5716 Jun 24 08:48:01.282105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1694955486 Jun 24 08:48:01.282105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-TestMinimumBasicScenario-1694955486-project Jun 24 08:48:01.282105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:48:01.282105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:48:01.282105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 4dbbf627f3bf4ffb87c6e23fac0b5002 Jun 24 08:48:01.282105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-TestMinimumBasicScenario-1694955486-project Jun 24 08:48:01.282105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:48:01.282105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 could not be found. Jun 24 08:48:01.282105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': '9754407b-6b66-4af9-8f31-452cfbbf19e4'} Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 could not be found. Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:48:01.283548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 could not be found. Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 could not be found. Jun 24 08:48:01.285097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:01.286848 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c91be0c4-9360-471f-bc9d-7a71db215a81 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Returning 404 to user: Instance 9754407b-6b66-4af9-8f31-452cfbbf19e4 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:48:01.286848 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c91be0c4-9360-471f-bc9d-7a71db215a81 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4" status: 404 len: 111 microversion: 2.1 time: 0.029286 Jun 24 08:48:01.286848 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 324/669] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:01 2022] GET /compute/v2.1/servers/9754407b-6b66-4af9-8f31-452cfbbf19e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:48:01.290859 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ae027cc4-d869-40a6-85e1-43f163fc7507 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] Calling method '.version_select at 0x7fb75c88aa60>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:01.310477 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ae027cc4-d869-40a6-85e1-43f163fc7507 tempest-TestMinimumBasicScenario-1694955486 tempest-TestMinimumBasicScenario-1694955486-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1927289998" status: 202 len: 0 microversion: 2.1 time: 0.023327 Jun 24 08:48:01.311032 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 346/670] 10.222.0.43 () {58 vars in 1271 bytes} [Fri Jun 24 08:48:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1927289998 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:48:01.324688 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3deaf6c6-fc7a-4e09-b241-21110b2bd2a5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:01.325272 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3deaf6c6-fc7a-4e09-b241-21110b2bd2a5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:01.382010 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3deaf6c6-fc7a-4e09-b241-21110b2bd2a5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:01.389620 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3deaf6c6-fc7a-4e09-b241-21110b2bd2a5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:01.391164 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3deaf6c6-fc7a-4e09-b241-21110b2bd2a5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:01.392317 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3deaf6c6-fc7a-4e09-b241-21110b2bd2a5 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1281 microversion: 2.20 time: 0.071554 Jun 24 08:48:01.393077 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 325/671] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:01 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:48:01.899350 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-00648db7-2bc0-4b6d-93c4-178d14c5b104 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:01.899991 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-00648db7-2bc0-4b6d-93c4-178d14c5b104 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:01.905867 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00648db7-2bc0-4b6d-93c4-178d14c5b104 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:01.906318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00648db7-2bc0-4b6d-93c4-178d14c5b104 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:01.907080 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00648db7-2bc0-4b6d-93c4-178d14c5b104 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:01.907540 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00648db7-2bc0-4b6d-93c4-178d14c5b104 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:02.036377 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-00648db7-2bc0-4b6d-93c4-178d14c5b104 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:02.043912 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-00648db7-2bc0-4b6d-93c4-178d14c5b104 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1566 microversion: 2.1 time: 0.148455 Jun 24 08:48:02.044468 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 347/672] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:01 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:02.410329 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a6a30e05-03ed-4900-aad5-3cbfa1d490eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:02.411032 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a6a30e05-03ed-4900-aad5-3cbfa1d490eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:02.469649 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a6a30e05-03ed-4900-aad5-3cbfa1d490eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:02.477308 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a6a30e05-03ed-4900-aad5-3cbfa1d490eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:02.479598 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a6a30e05-03ed-4900-aad5-3cbfa1d490eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:02.480827 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a6a30e05-03ed-4900-aad5-3cbfa1d490eb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1281 microversion: 2.20 time: 0.074378 Jun 24 08:48:02.481443 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 326/673] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:02 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:03.061187 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-dcc5aa23-1eef-4622-8fd2-6bc48382ba33 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:03.061807 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-dcc5aa23-1eef-4622-8fd2-6bc48382ba33 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:03.067718 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dcc5aa23-1eef-4622-8fd2-6bc48382ba33 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:03.068170 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dcc5aa23-1eef-4622-8fd2-6bc48382ba33 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:03.068935 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dcc5aa23-1eef-4622-8fd2-6bc48382ba33 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:03.069366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dcc5aa23-1eef-4622-8fd2-6bc48382ba33 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:03.214201 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-dcc5aa23-1eef-4622-8fd2-6bc48382ba33 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:03.222740 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-dcc5aa23-1eef-4622-8fd2-6bc48382ba33 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1566 microversion: 2.1 time: 0.165314 Jun 24 08:48:03.223343 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 348/674] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:03 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:03.499464 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cf756c4c-a950-4c60-b8bd-63f0675b05cf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:03.500285 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cf756c4c-a950-4c60-b8bd-63f0675b05cf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:03.571440 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cf756c4c-a950-4c60-b8bd-63f0675b05cf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:03.582549 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cf756c4c-a950-4c60-b8bd-63f0675b05cf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:03.584664 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cf756c4c-a950-4c60-b8bd-63f0675b05cf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:03.585975 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cf756c4c-a950-4c60-b8bd-63f0675b05cf tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1281 microversion: 2.20 time: 0.090561 Jun 24 08:48:03.586746 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 327/675] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:03 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:04.240419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9a3e0a39-6f1e-460d-bcea-0b7dd1adab0e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:04.241021 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9a3e0a39-6f1e-460d-bcea-0b7dd1adab0e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:04.248802 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9a3e0a39-6f1e-460d-bcea-0b7dd1adab0e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:04.249285 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9a3e0a39-6f1e-460d-bcea-0b7dd1adab0e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:04.250008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9a3e0a39-6f1e-460d-bcea-0b7dd1adab0e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:04.250437 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9a3e0a39-6f1e-460d-bcea-0b7dd1adab0e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:04.406456 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9a3e0a39-6f1e-460d-bcea-0b7dd1adab0e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:04.415278 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9a3e0a39-6f1e-460d-bcea-0b7dd1adab0e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1566 microversion: 2.1 time: 0.179184 Jun 24 08:48:04.415848 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 349/676] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:04 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:04.603749 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-36eeaedb-95dd-4d4f-bab9-951c5741eee4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:04.604324 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-36eeaedb-95dd-4d4f-bab9-951c5741eee4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:04.611497 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36eeaedb-95dd-4d4f-bab9-951c5741eee4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:04.611953 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36eeaedb-95dd-4d4f-bab9-951c5741eee4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:04.612719 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36eeaedb-95dd-4d4f-bab9-951c5741eee4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:04.613191 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36eeaedb-95dd-4d4f-bab9-951c5741eee4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:04.681192 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-36eeaedb-95dd-4d4f-bab9-951c5741eee4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:04.690590 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-36eeaedb-95dd-4d4f-bab9-951c5741eee4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:04.693531 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-36eeaedb-95dd-4d4f-bab9-951c5741eee4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:04.694851 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-36eeaedb-95dd-4d4f-bab9-951c5741eee4 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1285 microversion: 2.20 time: 0.095148 Jun 24 08:48:04.695618 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 328/677] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:04 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:05.432492 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2a02481f-28b7-4ead-9255-4a62fc472923 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:05.433027 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2a02481f-28b7-4ead-9255-4a62fc472923 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:05.439041 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a02481f-28b7-4ead-9255-4a62fc472923 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:05.439550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a02481f-28b7-4ead-9255-4a62fc472923 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:05.440315 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a02481f-28b7-4ead-9255-4a62fc472923 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:05.440750 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2a02481f-28b7-4ead-9255-4a62fc472923 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:05.461637 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:05.714495 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4c0f3d29-98d5-4445-857a-5fa180dd7a78 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:05.715111 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4c0f3d29-98d5-4445-857a-5fa180dd7a78 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:05.721547 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4c0f3d29-98d5-4445-857a-5fa180dd7a78 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:05.722007 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4c0f3d29-98d5-4445-857a-5fa180dd7a78 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:05.722776 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4c0f3d29-98d5-4445-857a-5fa180dd7a78 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:05.723240 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4c0f3d29-98d5-4445-857a-5fa180dd7a78 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:05.727361 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2a02481f-28b7-4ead-9255-4a62fc472923 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:05.735178 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2a02481f-28b7-4ead-9255-4a62fc472923 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1566 microversion: 2.1 time: 0.306509 Jun 24 08:48:05.735776 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 350/678] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:05 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1566 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:05.802950 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4c0f3d29-98d5-4445-857a-5fa180dd7a78 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:05.811746 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4c0f3d29-98d5-4445-857a-5fa180dd7a78 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:05.813270 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4c0f3d29-98d5-4445-857a-5fa180dd7a78 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:05.814935 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4c0f3d29-98d5-4445-857a-5fa180dd7a78 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1339 microversion: 2.20 time: 0.104267 Jun 24 08:48:05.815527 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 329/679] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:05 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1339 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:48:06.752265 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-58e75ca6-3ac6-4a12-8b19-a2407aea1f04 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:06.753784 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-58e75ca6-3ac6-4a12-8b19-a2407aea1f04 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:06.760892 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-58e75ca6-3ac6-4a12-8b19-a2407aea1f04 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:06.761445 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-58e75ca6-3ac6-4a12-8b19-a2407aea1f04 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:06.762318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-58e75ca6-3ac6-4a12-8b19-a2407aea1f04 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:06.762850 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-58e75ca6-3ac6-4a12-8b19-a2407aea1f04 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:06.836481 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-724eda96-231f-4643-a76f-d4dc3c7c8090 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:06.847080 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-724eda96-231f-4643-a76f-d4dc3c7c8090 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:06.856893 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-724eda96-231f-4643-a76f-d4dc3c7c8090 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:06.857593 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-724eda96-231f-4643-a76f-d4dc3c7c8090 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:06.858525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-724eda96-231f-4643-a76f-d4dc3c7c8090 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:06.859882 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-724eda96-231f-4643-a76f-d4dc3c7c8090 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:07.059328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-58e75ca6-3ac6-4a12-8b19-a2407aea1f04 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:07.069824 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-58e75ca6-3ac6-4a12-8b19-a2407aea1f04 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1566 microversion: 2.1 time: 0.321416 Jun 24 08:48:07.071236 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 351/680] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:06 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1566 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:07.078614 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-2ac98730-9aa1-4bfd-8cdd-f466e1deba86 req-873c91a9-7a38-405a-92d6-9511af65e3ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e8f47c2-c495-4707-8867-99604c4a1e73", "tag": "ddb01264-6505-4ff1-b632-85b797417418"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:07.091157 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-2ac98730-9aa1-4bfd-8cdd-f466e1deba86 req-873c91a9-7a38-405a-92d6-9511af65e3ee service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:07.091604 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-2ac98730-9aa1-4bfd-8cdd-f466e1deba86 req-873c91a9-7a38-405a-92d6-9511af65e3ee service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:07.111842 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-2ac98730-9aa1-4bfd-8cdd-f466e1deba86 req-873c91a9-7a38-405a-92d6-9511af65e3ee service nova] Creating event network-changed:ddb01264-6505-4ff1-b632-85b797417418 for instance 9e8f47c2-c495-4707-8867-99604c4a1e73 on hv-cinder-84517 Jun 24 08:48:07.120230 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-2ac98730-9aa1-4bfd-8cdd-f466e1deba86 req-873c91a9-7a38-405a-92d6-9511af65e3ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047616 Jun 24 08:48:07.121401 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 352/681] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:07.155464 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-724eda96-231f-4643-a76f-d4dc3c7c8090 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:07.170698 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-724eda96-231f-4643-a76f-d4dc3c7c8090 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:07.175267 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-724eda96-231f-4643-a76f-d4dc3c7c8090 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:07.177030 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-724eda96-231f-4643-a76f-d4dc3c7c8090 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1405 microversion: 2.20 time: 0.347207 Jun 24 08:48:07.177723 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 330/682] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:06 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1405 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:08.087606 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-95abc919-c6a9-446e-b127-62ba20a85125 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:08.088395 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-95abc919-c6a9-446e-b127-62ba20a85125 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:08.094673 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-95abc919-c6a9-446e-b127-62ba20a85125 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:08.095157 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-95abc919-c6a9-446e-b127-62ba20a85125 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:08.096504 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-95abc919-c6a9-446e-b127-62ba20a85125 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:08.096964 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-95abc919-c6a9-446e-b127-62ba20a85125 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:08.196747 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e50ddf24-dfc2-49fa-b759-73c52c397e02 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:08.197460 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e50ddf24-dfc2-49fa-b759-73c52c397e02 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:08.204385 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e50ddf24-dfc2-49fa-b759-73c52c397e02 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:08.205187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e50ddf24-dfc2-49fa-b759-73c52c397e02 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:08.206215 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e50ddf24-dfc2-49fa-b759-73c52c397e02 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:08.206754 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e50ddf24-dfc2-49fa-b759-73c52c397e02 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:08.362646 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-95abc919-c6a9-446e-b127-62ba20a85125 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:08.370976 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-95abc919-c6a9-446e-b127-62ba20a85125 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1566 microversion: 2.1 time: 0.287768 Jun 24 08:48:08.371861 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 353/683] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:08 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1566 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:08.431155 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e50ddf24-dfc2-49fa-b759-73c52c397e02 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:08.439778 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e50ddf24-dfc2-49fa-b759-73c52c397e02 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:08.441602 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e50ddf24-dfc2-49fa-b759-73c52c397e02 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:08.442914 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e50ddf24-dfc2-49fa-b759-73c52c397e02 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1405 microversion: 2.20 time: 0.251176 Jun 24 08:48:08.443573 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 331/684] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:08 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:48:09.388422 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-850507f4-ea01-43b4-ad9c-45bc0e04df9b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:09.389018 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-850507f4-ea01-43b4-ad9c-45bc0e04df9b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:09.395041 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-850507f4-ea01-43b4-ad9c-45bc0e04df9b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:09.395522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-850507f4-ea01-43b4-ad9c-45bc0e04df9b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:09.396481 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-850507f4-ea01-43b4-ad9c-45bc0e04df9b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:09.396920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-850507f4-ea01-43b4-ad9c-45bc0e04df9b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:09.461066 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7da64d99-3906-4282-9055-a5165036ce66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:09.461672 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7da64d99-3906-4282-9055-a5165036ce66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:09.468139 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7da64d99-3906-4282-9055-a5165036ce66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:09.468587 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7da64d99-3906-4282-9055-a5165036ce66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:09.469349 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7da64d99-3906-4282-9055-a5165036ce66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:09.469778 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7da64d99-3906-4282-9055-a5165036ce66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:09.569114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-850507f4-ea01-43b4-ad9c-45bc0e04df9b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:09.577000 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-850507f4-ea01-43b4-ad9c-45bc0e04df9b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1566 microversion: 2.1 time: 0.192371 Jun 24 08:48:09.577761 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 354/685] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:09 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:09.669373 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7da64d99-3906-4282-9055-a5165036ce66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:09.678780 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7da64d99-3906-4282-9055-a5165036ce66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:09.680739 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7da64d99-3906-4282-9055-a5165036ce66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:09.681681 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7da64d99-3906-4282-9055-a5165036ce66 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1405 microversion: 2.20 time: 0.224514 Jun 24 08:48:09.682315 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 332/686] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:09 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:48:10.597356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1966071b-53ad-459a-b04a-a695f1229233 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:10.597956 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1966071b-53ad-459a-b04a-a695f1229233 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:10.599900 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:10.600582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=12 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:10.606538 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1966071b-53ad-459a-b04a-a695f1229233 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:10.606975 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1966071b-53ad-459a-b04a-a695f1229233 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:10.607750 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1966071b-53ad-459a-b04a-a695f1229233 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:10.608183 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1966071b-53ad-459a-b04a-a695f1229233 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:10.699824 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3b2d2eee-2451-40ee-859a-647cf5c44362 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:10.700431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3b2d2eee-2451-40ee-859a-647cf5c44362 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:10.707083 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b2d2eee-2451-40ee-859a-647cf5c44362 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:10.707560 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b2d2eee-2451-40ee-859a-647cf5c44362 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:10.708317 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b2d2eee-2451-40ee-859a-647cf5c44362 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:10.708745 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3b2d2eee-2451-40ee-859a-647cf5c44362 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:10.735731 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1966071b-53ad-459a-b04a-a695f1229233 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:10.743369 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1966071b-53ad-459a-b04a-a695f1229233 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1566 microversion: 2.1 time: 0.150412 Jun 24 08:48:10.743956 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 355/687] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:10 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:10.835641 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3b2d2eee-2451-40ee-859a-647cf5c44362 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:10.843463 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3b2d2eee-2451-40ee-859a-647cf5c44362 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:10.844957 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3b2d2eee-2451-40ee-859a-647cf5c44362 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:10.846706 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3b2d2eee-2451-40ee-859a-647cf5c44362 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1405 microversion: 2.20 time: 0.150823 Jun 24 08:48:10.847273 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 333/688] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:10 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:48:11.760072 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d3053242-e7c8-48a9-b174-1a413f81bd12 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:11.760704 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d3053242-e7c8-48a9-b174-1a413f81bd12 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:11.766910 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3053242-e7c8-48a9-b174-1a413f81bd12 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:11.767680 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3053242-e7c8-48a9-b174-1a413f81bd12 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:11.768534 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3053242-e7c8-48a9-b174-1a413f81bd12 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:11.768969 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d3053242-e7c8-48a9-b174-1a413f81bd12 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:11.864610 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-042e2bc8-8bab-46f7-987b-402ca3a95455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:11.865216 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-042e2bc8-8bab-46f7-987b-402ca3a95455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:11.871941 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-042e2bc8-8bab-46f7-987b-402ca3a95455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:11.872591 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-042e2bc8-8bab-46f7-987b-402ca3a95455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:11.873359 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-042e2bc8-8bab-46f7-987b-402ca3a95455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:11.873789 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-042e2bc8-8bab-46f7-987b-402ca3a95455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:11.897337 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d3053242-e7c8-48a9-b174-1a413f81bd12 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:11.905059 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d3053242-e7c8-48a9-b174-1a413f81bd12 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1566 microversion: 2.1 time: 0.148739 Jun 24 08:48:11.905632 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 356/689] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:11 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:12.015066 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-042e2bc8-8bab-46f7-987b-402ca3a95455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:12.023361 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-042e2bc8-8bab-46f7-987b-402ca3a95455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:12.024856 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-042e2bc8-8bab-46f7-987b-402ca3a95455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:12.025932 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-042e2bc8-8bab-46f7-987b-402ca3a95455 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1405 microversion: 2.20 time: 0.165794 Jun 24 08:48:12.026487 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 334/690] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:11 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:48:12.922097 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-eaf37db3-8308-4e35-9f2d-0d8253436396 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:12.922709 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-eaf37db3-8308-4e35-9f2d-0d8253436396 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:12.929278 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eaf37db3-8308-4e35-9f2d-0d8253436396 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:12.929719 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eaf37db3-8308-4e35-9f2d-0d8253436396 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:12.930467 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eaf37db3-8308-4e35-9f2d-0d8253436396 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:12.930896 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eaf37db3-8308-4e35-9f2d-0d8253436396 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:13.044519 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dd64d50e-fd9c-43bb-b813-757f342a8fca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:13.045123 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dd64d50e-fd9c-43bb-b813-757f342a8fca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:13.052270 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd64d50e-fd9c-43bb-b813-757f342a8fca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:13.052713 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd64d50e-fd9c-43bb-b813-757f342a8fca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:13.053498 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd64d50e-fd9c-43bb-b813-757f342a8fca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:13.053929 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dd64d50e-fd9c-43bb-b813-757f342a8fca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:13.059243 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-eaf37db3-8308-4e35-9f2d-0d8253436396 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:13.067533 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-eaf37db3-8308-4e35-9f2d-0d8253436396 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1566 microversion: 2.1 time: 0.149595 Jun 24 08:48:13.068095 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 357/691] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:12 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:13.179611 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dd64d50e-fd9c-43bb-b813-757f342a8fca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:13.187517 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dd64d50e-fd9c-43bb-b813-757f342a8fca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:13.189008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dd64d50e-fd9c-43bb-b813-757f342a8fca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:13.190143 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dd64d50e-fd9c-43bb-b813-757f342a8fca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1405 microversion: 2.20 time: 0.149585 Jun 24 08:48:13.190889 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 335/692] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:13 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:14.085205 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-453403db-5987-4279-b1cb-7b534dc0c100 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:14.085805 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-453403db-5987-4279-b1cb-7b534dc0c100 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:14.087792 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:14.093644 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-453403db-5987-4279-b1cb-7b534dc0c100 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.094095 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-453403db-5987-4279-b1cb-7b534dc0c100 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.094869 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-453403db-5987-4279-b1cb-7b534dc0c100 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.095348 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-453403db-5987-4279-b1cb-7b534dc0c100 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.102822 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-64b67c6e-35b0-416d-97bd-57ffb1029a01 req-33ff5cf6-000d-414f-879b-ad15d4063c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8f47c2-c495-4707-8867-99604c4a1e73", "name": "network-vif-plugged", "status": "completed", "tag": "ddb01264-6505-4ff1-b632-85b797417418"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:14.112442 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-64b67c6e-35b0-416d-97bd-57ffb1029a01 req-33ff5cf6-000d-414f-879b-ad15d4063c2c service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.113318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-64b67c6e-35b0-416d-97bd-57ffb1029a01 req-33ff5cf6-000d-414f-879b-ad15d4063c2c service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.125721 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-64b67c6e-35b0-416d-97bd-57ffb1029a01 req-33ff5cf6-000d-414f-879b-ad15d4063c2c service nova] Creating event network-vif-plugged:ddb01264-6505-4ff1-b632-85b797417418 for instance 9e8f47c2-c495-4707-8867-99604c4a1e73 on hv-cinder-84517 Jun 24 08:48:14.131264 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-64b67c6e-35b0-416d-97bd-57ffb1029a01 req-33ff5cf6-000d-414f-879b-ad15d4063c2c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220393 Jun 24 08:48:14.131807 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 358/693] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:14.209440 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a6263803-f82b-4d4b-91e3-7bfd03b7cf73 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:14.210171 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a6263803-f82b-4d4b-91e3-7bfd03b7cf73 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:14.216600 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a6263803-f82b-4d4b-91e3-7bfd03b7cf73 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.217727 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a6263803-f82b-4d4b-91e3-7bfd03b7cf73 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.218671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a6263803-f82b-4d4b-91e3-7bfd03b7cf73 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.219115 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a6263803-f82b-4d4b-91e3-7bfd03b7cf73 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.235375 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-453403db-5987-4279-b1cb-7b534dc0c100 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:14.243660 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-453403db-5987-4279-b1cb-7b534dc0c100 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1507 microversion: 2.1 time: 0.162148 Jun 24 08:48:14.255557 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 336/694] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:14 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:14.260752 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5f529e1e-3c1e-45bc-9169-80af58c6decc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:14.261510 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5f529e1e-3c1e-45bc-9169-80af58c6decc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:14.268859 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5f529e1e-3c1e-45bc-9169-80af58c6decc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.269332 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5f529e1e-3c1e-45bc-9169-80af58c6decc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.270185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5f529e1e-3c1e-45bc-9169-80af58c6decc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.270660 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5f529e1e-3c1e-45bc-9169-80af58c6decc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.356899 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5f529e1e-3c1e-45bc-9169-80af58c6decc tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "POST /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926/action" status: 202 len: 0 microversion: 2.1 time: 0.099817 Jun 24 08:48:14.357728 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 337/695] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Jun 24 08:48:14 2022] POST /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:48:14.365041 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a6263803-f82b-4d4b-91e3-7bfd03b7cf73 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:14.366279 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e956a527-36b2-4b48-b4d5-1e0fdc6ae45a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:14.367334 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e956a527-36b2-4b48-b4d5-1e0fdc6ae45a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:14.374837 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e956a527-36b2-4b48-b4d5-1e0fdc6ae45a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.375729 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e956a527-36b2-4b48-b4d5-1e0fdc6ae45a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.377350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e956a527-36b2-4b48-b4d5-1e0fdc6ae45a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.377924 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a6263803-f82b-4d4b-91e3-7bfd03b7cf73 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:14.378123 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e956a527-36b2-4b48-b4d5-1e0fdc6ae45a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.379711 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a6263803-f82b-4d4b-91e3-7bfd03b7cf73 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:14.381111 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a6263803-f82b-4d4b-91e3-7bfd03b7cf73 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1405 microversion: 2.20 time: 0.177128 Jun 24 08:48:14.382058 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 359/696] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:14 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:48:14.525419 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e956a527-36b2-4b48-b4d5-1e0fdc6ae45a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:14.532803 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e956a527-36b2-4b48-b4d5-1e0fdc6ae45a tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1515 microversion: 2.1 time: 0.170850 Jun 24 08:48:14.533376 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 338/697] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:14 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:15.399652 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-267ef9e9-cd21-4184-9047-0892b37d95e6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:15.400213 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-267ef9e9-cd21-4184-9047-0892b37d95e6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:15.403334 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:15.407358 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-267ef9e9-cd21-4184-9047-0892b37d95e6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:15.407807 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-267ef9e9-cd21-4184-9047-0892b37d95e6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:15.409205 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-267ef9e9-cd21-4184-9047-0892b37d95e6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:15.409642 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-267ef9e9-cd21-4184-9047-0892b37d95e6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:15.536574 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-267ef9e9-cd21-4184-9047-0892b37d95e6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:15.545011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-267ef9e9-cd21-4184-9047-0892b37d95e6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:15.546533 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-267ef9e9-cd21-4184-9047-0892b37d95e6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:15.547932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-267ef9e9-cd21-4184-9047-0892b37d95e6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1405 microversion: 2.20 time: 0.152229 Jun 24 08:48:15.548476 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 360/698] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:15 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:15.549950 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-798a5250-134d-4b0e-97c7-1e57b934835d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:15.550607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-798a5250-134d-4b0e-97c7-1e57b934835d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:15.559614 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-798a5250-134d-4b0e-97c7-1e57b934835d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:15.560308 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-798a5250-134d-4b0e-97c7-1e57b934835d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:15.561086 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-798a5250-134d-4b0e-97c7-1e57b934835d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:15.561520 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-798a5250-134d-4b0e-97c7-1e57b934835d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:15.692016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-798a5250-134d-4b0e-97c7-1e57b934835d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:15.699286 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-798a5250-134d-4b0e-97c7-1e57b934835d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1517 microversion: 2.1 time: 0.153418 Jun 24 08:48:15.699869 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 339/699] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:15 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:16.565865 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-674e82dd-0047-45b3-8966-a85ea364274c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:16.566512 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-674e82dd-0047-45b3-8966-a85ea364274c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:16.572464 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-674e82dd-0047-45b3-8966-a85ea364274c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:16.572911 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-674e82dd-0047-45b3-8966-a85ea364274c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:16.573668 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-674e82dd-0047-45b3-8966-a85ea364274c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:16.574098 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-674e82dd-0047-45b3-8966-a85ea364274c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:16.700849 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-674e82dd-0047-45b3-8966-a85ea364274c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:16.709201 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-674e82dd-0047-45b3-8966-a85ea364274c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:16.710758 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-674e82dd-0047-45b3-8966-a85ea364274c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:16.712233 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-674e82dd-0047-45b3-8966-a85ea364274c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1596 microversion: 2.20 time: 0.149974 Jun 24 08:48:16.712808 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 361/700] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:16 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1596 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:48:16.717234 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8ddfe0c8-77c9-4053-8873-eb9a8b7d01b7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:16.717904 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8ddfe0c8-77c9-4053-8873-eb9a8b7d01b7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:16.725758 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8ddfe0c8-77c9-4053-8873-eb9a8b7d01b7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:16.726238 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8ddfe0c8-77c9-4053-8873-eb9a8b7d01b7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:16.727033 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8ddfe0c8-77c9-4053-8873-eb9a8b7d01b7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:16.727503 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8ddfe0c8-77c9-4053-8873-eb9a8b7d01b7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:16.730566 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-242d232d-a846-4adb-98ef-e902f305de17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:16.731175 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-242d232d-a846-4adb-98ef-e902f305de17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:16.737099 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-242d232d-a846-4adb-98ef-e902f305de17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:16.737615 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-242d232d-a846-4adb-98ef-e902f305de17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:16.738440 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-242d232d-a846-4adb-98ef-e902f305de17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:16.738874 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-242d232d-a846-4adb-98ef-e902f305de17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:16.847784 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-242d232d-a846-4adb-98ef-e902f305de17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.121088 Jun 24 08:48:16.850228 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 362/701] 10.222.0.43 () {60 vars in 1315 bytes} [Fri Jun 24 08:48:16 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:48:16.894168 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8ddfe0c8-77c9-4053-8873-eb9a8b7d01b7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:16.903262 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8ddfe0c8-77c9-4053-8873-eb9a8b7d01b7 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1573 microversion: 2.1 time: 0.190096 Jun 24 08:48:16.903881 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 340/702] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:16 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1573 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:17.884617 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-85294ceb-c099-4674-a32d-e7fd14f0bc77 req-1dbe6849-a451-483c-a10e-79ddc19e1308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73106291-ded8-47c4-8b9f-6ee2c7fe3926", "name": "network-vif-unplugged", "status": "completed", "tag": "431156a0-7086-4030-a88f-b4d0acbdcfb2"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:17.893899 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-85294ceb-c099-4674-a32d-e7fd14f0bc77 req-1dbe6849-a451-483c-a10e-79ddc19e1308 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:17.894541 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-85294ceb-c099-4674-a32d-e7fd14f0bc77 req-1dbe6849-a451-483c-a10e-79ddc19e1308 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:17.910398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-85294ceb-c099-4674-a32d-e7fd14f0bc77 req-1dbe6849-a451-483c-a10e-79ddc19e1308 service nova] Creating event network-vif-unplugged:431156a0-7086-4030-a88f-b4d0acbdcfb2 for instance 73106291-ded8-47c4-8b9f-6ee2c7fe3926 on hv-cinder-84517 Jun 24 08:48:17.920021 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-85294ceb-c099-4674-a32d-e7fd14f0bc77 req-1dbe6849-a451-483c-a10e-79ddc19e1308 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038515 Jun 24 08:48:17.921093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 363/703] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:17.926555 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9a11e12d-8c70-4b82-a9b0-42919ceef557 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:17.927400 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9a11e12d-8c70-4b82-a9b0-42919ceef557 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:17.935557 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a11e12d-8c70-4b82-a9b0-42919ceef557 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:17.936117 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a11e12d-8c70-4b82-a9b0-42919ceef557 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:17.937678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a11e12d-8c70-4b82-a9b0-42919ceef557 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:17.938616 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a11e12d-8c70-4b82-a9b0-42919ceef557 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:18.071167 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9a11e12d-8c70-4b82-a9b0-42919ceef557 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:18.078637 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9a11e12d-8c70-4b82-a9b0-42919ceef557 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1573 microversion: 2.1 time: 0.160029 Jun 24 08:48:18.079489 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 341/704] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:17 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:18.459312 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-87cf08dc-03eb-4513-97b3-c8a3565ae6f9 req-98f4ead9-8a35-4f30-81ed-3cf804dce3ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e8f47c2-c495-4707-8867-99604c4a1e73", "tag": "ddb01264-6505-4ff1-b632-85b797417418"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:18.467368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-87cf08dc-03eb-4513-97b3-c8a3565ae6f9 req-98f4ead9-8a35-4f30-81ed-3cf804dce3ba service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:18.467816 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-87cf08dc-03eb-4513-97b3-c8a3565ae6f9 req-98f4ead9-8a35-4f30-81ed-3cf804dce3ba service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:18.479109 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-87cf08dc-03eb-4513-97b3-c8a3565ae6f9 req-98f4ead9-8a35-4f30-81ed-3cf804dce3ba service nova] Creating event network-changed:ddb01264-6505-4ff1-b632-85b797417418 for instance 9e8f47c2-c495-4707-8867-99604c4a1e73 on hv-cinder-84517 Jun 24 08:48:18.484749 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-87cf08dc-03eb-4513-97b3-c8a3565ae6f9 req-98f4ead9-8a35-4f30-81ed-3cf804dce3ba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030069 Jun 24 08:48:18.485511 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 364/705] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:19.096165 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-31fe2c6c-d464-4fb3-b710-c26c09477477 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:19.096935 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-31fe2c6c-d464-4fb3-b710-c26c09477477 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:19.103923 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-31fe2c6c-d464-4fb3-b710-c26c09477477 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:19.104371 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-31fe2c6c-d464-4fb3-b710-c26c09477477 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:19.105146 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-31fe2c6c-d464-4fb3-b710-c26c09477477 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:19.105582 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-31fe2c6c-d464-4fb3-b710-c26c09477477 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:19.124106 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:19.255774 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-31fe2c6c-d464-4fb3-b710-c26c09477477 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:19.263846 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-31fe2c6c-d464-4fb3-b710-c26c09477477 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1573 microversion: 2.1 time: 0.171398 Jun 24 08:48:19.264522 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 342/706] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:19 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1573 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:19.533777 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-742d8ab6-d7c3-4d3b-b144-9d355635b5c4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:19.534407 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-742d8ab6-d7c3-4d3b-b144-9d355635b5c4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:19.540738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-742d8ab6-d7c3-4d3b-b144-9d355635b5c4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:19.541183 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-742d8ab6-d7c3-4d3b-b144-9d355635b5c4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:19.541933 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-742d8ab6-d7c3-4d3b-b144-9d355635b5c4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:19.542362 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-742d8ab6-d7c3-4d3b-b144-9d355635b5c4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:19.569599 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-742d8ab6-d7c3-4d3b-b144-9d355635b5c4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:48:19.645943 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-742d8ab6-d7c3-4d3b-b144-9d355635b5c4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 204 len: 0 microversion: 2.1 time: 0.116236 Jun 24 08:48:19.647133 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 365/707] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:48:19 2022] DELETE /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:48:19.655188 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-19a7d984-ba52-4fae-867f-7b233e25c188 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:19.655824 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-19a7d984-ba52-4fae-867f-7b233e25c188 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:19.662207 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19a7d984-ba52-4fae-867f-7b233e25c188 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:19.662649 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19a7d984-ba52-4fae-867f-7b233e25c188 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:19.663506 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19a7d984-ba52-4fae-867f-7b233e25c188 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:19.663933 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-19a7d984-ba52-4fae-867f-7b233e25c188 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:19.795489 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-19a7d984-ba52-4fae-867f-7b233e25c188 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:19.803800 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-19a7d984-ba52-4fae-867f-7b233e25c188 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1575 microversion: 2.1 time: 0.152433 Jun 24 08:48:19.804382 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 343/708] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:19 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:20.281130 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cf3722b4-02eb-4ae7-bf5c-076c2d5837d2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:20.281835 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cf3722b4-02eb-4ae7-bf5c-076c2d5837d2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:20.287756 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cf3722b4-02eb-4ae7-bf5c-076c2d5837d2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:20.288194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cf3722b4-02eb-4ae7-bf5c-076c2d5837d2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:20.288942 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cf3722b4-02eb-4ae7-bf5c-076c2d5837d2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:20.289369 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cf3722b4-02eb-4ae7-bf5c-076c2d5837d2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:20.419821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cf3722b4-02eb-4ae7-bf5c-076c2d5837d2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:20.428472 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cf3722b4-02eb-4ae7-bf5c-076c2d5837d2 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1573 microversion: 2.1 time: 0.151513 Jun 24 08:48:20.429064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 366/709] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:20 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:20.821295 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fdbd92aa-9825-4670-a768-5e77fe93477d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:20.821903 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fdbd92aa-9825-4670-a768-5e77fe93477d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:20.824227 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:20.829382 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fdbd92aa-9825-4670-a768-5e77fe93477d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:20.830344 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fdbd92aa-9825-4670-a768-5e77fe93477d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:20.831102 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fdbd92aa-9825-4670-a768-5e77fe93477d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:20.831556 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fdbd92aa-9825-4670-a768-5e77fe93477d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:20.958771 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fdbd92aa-9825-4670-a768-5e77fe93477d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:20.966247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fdbd92aa-9825-4670-a768-5e77fe93477d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1575 microversion: 2.1 time: 0.148795 Jun 24 08:48:20.966809 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 344/710] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:20 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:21.445937 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-989254db-5aa8-4819-beaa-0444e11bf108 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:21.446487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-989254db-5aa8-4819-beaa-0444e11bf108 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:21.452886 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-989254db-5aa8-4819-beaa-0444e11bf108 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:21.453326 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-989254db-5aa8-4819-beaa-0444e11bf108 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:21.454085 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-989254db-5aa8-4819-beaa-0444e11bf108 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:21.454508 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-989254db-5aa8-4819-beaa-0444e11bf108 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:21.581244 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-989254db-5aa8-4819-beaa-0444e11bf108 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:21.590296 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-989254db-5aa8-4819-beaa-0444e11bf108 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1573 microversion: 2.1 time: 0.148317 Jun 24 08:48:21.590860 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 367/711] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:21 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:21.984884 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cd3c97eb-ebae-4cb1-ae1f-9cf81c205e59 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:21.985507 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cd3c97eb-ebae-4cb1-ae1f-9cf81c205e59 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:21.992570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd3c97eb-ebae-4cb1-ae1f-9cf81c205e59 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:21.993049 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd3c97eb-ebae-4cb1-ae1f-9cf81c205e59 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:21.993953 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd3c97eb-ebae-4cb1-ae1f-9cf81c205e59 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:21.994475 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cd3c97eb-ebae-4cb1-ae1f-9cf81c205e59 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:22.137010 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cd3c97eb-ebae-4cb1-ae1f-9cf81c205e59 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:22.144437 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cd3c97eb-ebae-4cb1-ae1f-9cf81c205e59 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1575 microversion: 2.1 time: 0.164096 Jun 24 08:48:22.145003 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 345/712] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:21 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:22.343998 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-0e6e7ce2-9ff8-4f09-8cca-51bb2ea7bd2c req-fdef345e-2332-4e3d-be54-355e4cdb4c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7361cf5e-5979-4b93-97db-69e8a678dfa3", "name": "network-vif-deleted", "tag": "4535b51a-3287-40ad-b3cf-f032fe1dd901"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:22.355440 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0e6e7ce2-9ff8-4f09-8cca-51bb2ea7bd2c req-fdef345e-2332-4e3d-be54-355e4cdb4c6d service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:22.355857 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0e6e7ce2-9ff8-4f09-8cca-51bb2ea7bd2c req-fdef345e-2332-4e3d-be54-355e4cdb4c6d service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:22.367545 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-0e6e7ce2-9ff8-4f09-8cca-51bb2ea7bd2c req-fdef345e-2332-4e3d-be54-355e4cdb4c6d service nova] Creating event network-vif-deleted:4535b51a-3287-40ad-b3cf-f032fe1dd901 for instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 on hv-cinder-84517 Jun 24 08:48:22.373367 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-0e6e7ce2-9ff8-4f09-8cca-51bb2ea7bd2c req-fdef345e-2332-4e3d-be54-355e4cdb4c6d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032856 Jun 24 08:48:22.374028 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 368/713] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:22.606502 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a36ade55-c0fa-464f-af6c-6d680a4c86a9 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:22.607114 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a36ade55-c0fa-464f-af6c-6d680a4c86a9 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:22.613840 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a36ade55-c0fa-464f-af6c-6d680a4c86a9 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:22.614286 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a36ade55-c0fa-464f-af6c-6d680a4c86a9 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:22.615069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a36ade55-c0fa-464f-af6c-6d680a4c86a9 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:22.615514 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a36ade55-c0fa-464f-af6c-6d680a4c86a9 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:22.749349 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a36ade55-c0fa-464f-af6c-6d680a4c86a9 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:22.758082 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a36ade55-c0fa-464f-af6c-6d680a4c86a9 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1573 microversion: 2.1 time: 0.155316 Jun 24 08:48:22.759101 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 346/714] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:22 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:23.162801 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-89d001f8-dd94-43a7-abac-439c42cf6da7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:23.164512 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-89d001f8-dd94-43a7-abac-439c42cf6da7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:23.178335 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-89d001f8-dd94-43a7-abac-439c42cf6da7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:23.178335 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-89d001f8-dd94-43a7-abac-439c42cf6da7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:23.178335 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-89d001f8-dd94-43a7-abac-439c42cf6da7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:23.178335 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-89d001f8-dd94-43a7-abac-439c42cf6da7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:23.183128 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:23.214104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-89d001f8-dd94-43a7-abac-439c42cf6da7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:23.215008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-89d001f8-dd94-43a7-abac-439c42cf6da7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:23.215451 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-89d001f8-dd94-43a7-abac-439c42cf6da7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lazy-loading 'fault' on Instance uuid 7361cf5e-5979-4b93-97db-69e8a678dfa3 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:48:23.262280 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-89d001f8-dd94-43a7-abac-439c42cf6da7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:23.269820 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-89d001f8-dd94-43a7-abac-439c42cf6da7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 200 len: 1183 microversion: 2.1 time: 0.111838 Jun 24 08:48:23.270431 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 369/715] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:23 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 1183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:23.775256 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3ff44a08-ecf8-49e6-8451-0811c81d961e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:23.775829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3ff44a08-ecf8-49e6-8451-0811c81d961e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:23.782230 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ff44a08-ecf8-49e6-8451-0811c81d961e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:23.782671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ff44a08-ecf8-49e6-8451-0811c81d961e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:23.783454 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ff44a08-ecf8-49e6-8451-0811c81d961e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:23.783882 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3ff44a08-ecf8-49e6-8451-0811c81d961e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:23.914220 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3ff44a08-ecf8-49e6-8451-0811c81d961e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:23.921566 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3ff44a08-ecf8-49e6-8451-0811c81d961e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1573 microversion: 2.1 time: 0.150241 Jun 24 08:48:23.922384 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 347/716] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:23 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:24.018198 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d6e794dd-3735-4cf8-b0e0-f4087a93bcc6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:24.018694 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d6e794dd-3735-4cf8-b0e0-f4087a93bcc6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:24.024557 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6e794dd-3735-4cf8-b0e0-f4087a93bcc6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:24.025003 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6e794dd-3735-4cf8-b0e0-f4087a93bcc6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:24.025808 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6e794dd-3735-4cf8-b0e0-f4087a93bcc6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:24.026187 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d6e794dd-3735-4cf8-b0e0-f4087a93bcc6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:24.106360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-d6e794dd-3735-4cf8-b0e0-f4087a93bcc6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lazy-loading 'services' on Instance uuid 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:48:24.215491 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d6e794dd-3735-4cf8-b0e0-f4087a93bcc6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-volume_attachments/c275e410-8759-4006-b5b0-3fa83f01f456" status: 202 len: 0 microversion: 2.1 time: 0.200952 Jun 24 08:48:24.216112 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 370/717] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Jun 24 08:48:24 2022] DELETE /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-volume_attachments/c275e410-8759-4006-b5b0-3fa83f01f456 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:48:24.225116 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f50827fc-799c-44a4-bb20-8fde8a0bcd66 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:24.226103 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f50827fc-799c-44a4-bb20-8fde8a0bcd66 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:24.232097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f50827fc-799c-44a4-bb20-8fde8a0bcd66 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:24.232539 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f50827fc-799c-44a4-bb20-8fde8a0bcd66 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:24.233303 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f50827fc-799c-44a4-bb20-8fde8a0bcd66 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:24.233716 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f50827fc-799c-44a4-bb20-8fde8a0bcd66 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:24.261795 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f50827fc-799c-44a4-bb20-8fde8a0bcd66 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040642 Jun 24 08:48:24.262325 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 348/718] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:48:24 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:24.288291 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9032ea11-0263-4295-ad72-00196c1d851d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:24.288896 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9032ea11-0263-4295-ad72-00196c1d851d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:24.295005 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9032ea11-0263-4295-ad72-00196c1d851d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:24.295483 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9032ea11-0263-4295-ad72-00196c1d851d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:24.296237 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9032ea11-0263-4295-ad72-00196c1d851d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:24.296659 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9032ea11-0263-4295-ad72-00196c1d851d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:24.310403 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-9032ea11-0263-4295-ad72-00196c1d851d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] HTTP exception thrown: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9032ea11-0263-4295-ad72-00196c1d851d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Request method failure captured: Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 HTTP/1.1 Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXlvcj740GAXS8rpxFHO7HajxPWrmwYlx3RSIokdv0haB_yxqHtwAjETWOIhVbbqRtRcvAEVLPxozLuxna8w1m4vBt-7lOfpH_NDmJC7yngKQO3Aw6fr_Dh3KrosQWmzqzDvLmNOh6xLnDUq6VXwhYma19B_7h5bh5qaV_rPKbKnoKM Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 891980c3542d4223a15461bb7c5dcff9 Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:48:24.312022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:48:24.313657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_891980c3542d4223a15461bb7c5dcff9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:48:24.313657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:48:24.313657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 891980c3542d4223a15461bb7c5dcff9 Jun 24 08:48:24.313657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:48:24.313657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-TestVolumeBootPattern-1314763452-project Jun 24 08:48:24.313657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:48:24.313657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:48:24.313657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 7f65bea891fb461086d6a60177ff2d65 Jun 24 08:48:24.313657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-TestVolumeBootPattern-1314763452-project Jun 24 08:48:24.313657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:48:24.313657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:48:24.313657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '7361cf5e-5979-4b93-97db-69e8a678dfa3'} Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:48:24.314763 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:48:24.316275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:24.317576 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9032ea11-0263-4295-ad72-00196c1d851d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Returning 404 to user: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:48:24.317576 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9032ea11-0263-4295-ad72-00196c1d851d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 404 len: 111 microversion: 2.1 time: 0.029511 Jun 24 08:48:24.317576 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 371/719] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:24 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:48:24.404275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-494343484", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1167158324", "security_groups": [{"name": "tempest-secgroup-smoke-1577723221"}], "block_device_mapping_v2": [{"uuid": "d15aeb4a-a69d-422c-92d6-dbfa522c8f59", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ee4277a5-1041-408a-bfe3-ce6a3f8905d0"}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:24.513308 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] validate_networks() for [('ee4277a5-1041-408a-bfe3-ce6a3f8905d0', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:48:24.939446 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c640b82c-13e5-4609-b8ed-e0dc0faadd56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:24.940107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c640b82c-13e5-4609-b8ed-e0dc0faadd56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:24.946334 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c640b82c-13e5-4609-b8ed-e0dc0faadd56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:24.946799 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c640b82c-13e5-4609-b8ed-e0dc0faadd56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:24.947797 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c640b82c-13e5-4609-b8ed-e0dc0faadd56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:24.948405 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c640b82c-13e5-4609-b8ed-e0dc0faadd56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:24.967810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:48:24.968697 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:48:24.969552 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:48:24.970449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:48:24.971348 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:48:24.984755 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:24.985322 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:24.986193 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:24.986698 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:25.005084 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Getting quotas for project 891980c3542d4223a15461bb7c5dcff9. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:48:25.009137 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Getting quotas for user 7f65bea891fb461086d6a60177ff2d65 and project 891980c3542d4223a15461bb7c5dcff9. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:48:25.068159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:48:25.070240 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d15aeb4a-a69d-422c-92d6-dbfa522c8f59',volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:48:25.092906 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c640b82c-13e5-4609-b8ed-e0dc0faadd56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:25.101305 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c640b82c-13e5-4609-b8ed-e0dc0faadd56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1573 microversion: 2.1 time: 0.166275 Jun 24 08:48:25.102177 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 372/720] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:24 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:25.210144 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b4637725-b51b-4d58-8eb4-50dd02ed1c35 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.809799 Jun 24 08:48:25.210785 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 349/721] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:48:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:48:25.220841 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ef6d9204-6401-49e4-a813-1059379922c0 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:25.221451 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ef6d9204-6401-49e4-a813-1059379922c0 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:25.273891 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5da27507-82e5-4a6d-bf2b-e6eb92c02d27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:25.274872 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5da27507-82e5-4a6d-bf2b-e6eb92c02d27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:25.278432 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ef6d9204-6401-49e4-a813-1059379922c0 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:25.281891 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5da27507-82e5-4a6d-bf2b-e6eb92c02d27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:25.282291 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5da27507-82e5-4a6d-bf2b-e6eb92c02d27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:25.283109 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5da27507-82e5-4a6d-bf2b-e6eb92c02d27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:25.283574 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5da27507-82e5-4a6d-bf2b-e6eb92c02d27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:25.285775 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ef6d9204-6401-49e4-a813-1059379922c0 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1094 microversion: 2.1 time: 0.068975 Jun 24 08:48:25.286470 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 373/722] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:25 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:25.322173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5da27507-82e5-4a6d-bf2b-e6eb92c02d27 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052320 Jun 24 08:48:25.322860 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 350/723] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:48:25 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:48:26.117805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e78c4822-9a40-4be7-ace1-d8924ca04c1c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:26.118442 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e78c4822-9a40-4be7-ace1-d8924ca04c1c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:26.124612 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e78c4822-9a40-4be7-ace1-d8924ca04c1c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:26.125087 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e78c4822-9a40-4be7-ace1-d8924ca04c1c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:26.125851 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e78c4822-9a40-4be7-ace1-d8924ca04c1c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:26.126285 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e78c4822-9a40-4be7-ace1-d8924ca04c1c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:26.251655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e78c4822-9a40-4be7-ace1-d8924ca04c1c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:26.259074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e78c4822-9a40-4be7-ace1-d8924ca04c1c tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1573 microversion: 2.1 time: 0.145087 Jun 24 08:48:26.259658 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 374/724] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:26 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1573 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:26.302831 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-26d72ff1-f5c4-42ae-8e50-135e59cf2e40 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:26.303553 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-26d72ff1-f5c4-42ae-8e50-135e59cf2e40 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:26.310229 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-26d72ff1-f5c4-42ae-8e50-135e59cf2e40 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:26.310704 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-26d72ff1-f5c4-42ae-8e50-135e59cf2e40 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:26.311515 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-26d72ff1-f5c4-42ae-8e50-135e59cf2e40 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:26.311996 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-26d72ff1-f5c4-42ae-8e50-135e59cf2e40 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:26.334447 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3210c46f-3fa5-41f1-b7ef-d5cdd1b79368 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:26.335458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3210c46f-3fa5-41f1-b7ef-d5cdd1b79368 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:26.341438 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3210c46f-3fa5-41f1-b7ef-d5cdd1b79368 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:26.341824 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3210c46f-3fa5-41f1-b7ef-d5cdd1b79368 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:26.342620 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3210c46f-3fa5-41f1-b7ef-d5cdd1b79368 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:26.343054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3210c46f-3fa5-41f1-b7ef-d5cdd1b79368 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:26.372101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3210c46f-3fa5-41f1-b7ef-d5cdd1b79368 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041925 Jun 24 08:48:26.372496 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 375/725] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:48:26 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 08:48:26.374393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-26d72ff1-f5c4-42ae-8e50-135e59cf2e40 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:26.382399 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-26d72ff1-f5c4-42ae-8e50-135e59cf2e40 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1136 microversion: 2.1 time: 0.083524 Jun 24 08:48:26.383073 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 351/726] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:26 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:26.444833 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d007d18a-fce8-4d06-9a35-ad5d4110db5e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:26.445322 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d007d18a-fce8-4d06-9a35-ad5d4110db5e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:26.451380 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d007d18a-fce8-4d06-9a35-ad5d4110db5e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:26.451823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d007d18a-fce8-4d06-9a35-ad5d4110db5e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:26.452571 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d007d18a-fce8-4d06-9a35-ad5d4110db5e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:26.452997 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d007d18a-fce8-4d06-9a35-ad5d4110db5e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:26.477299 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d007d18a-fce8-4d06-9a35-ad5d4110db5e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:48:26.549044 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d007d18a-fce8-4d06-9a35-ad5d4110db5e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 204 len: 0 microversion: 2.1 time: 0.107775 Jun 24 08:48:26.549615 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 376/727] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:48:26 2022] DELETE /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:48:26.557428 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d5271342-0443-4253-a25f-6021bc254642 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:26.558046 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d5271342-0443-4253-a25f-6021bc254642 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:26.564013 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5271342-0443-4253-a25f-6021bc254642 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:26.564978 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5271342-0443-4253-a25f-6021bc254642 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:26.565780 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5271342-0443-4253-a25f-6021bc254642 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:26.566215 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d5271342-0443-4253-a25f-6021bc254642 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:26.945282 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d5271342-0443-4253-a25f-6021bc254642 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:26.952623 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d5271342-0443-4253-a25f-6021bc254642 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1687 microversion: 2.1 time: 0.398939 Jun 24 08:48:26.953184 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 352/728] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:26 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1687 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:27.277046 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1c5e9b49-de6a-4afa-bddc-8a6cb3be0fbd tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:27.277748 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1c5e9b49-de6a-4afa-bddc-8a6cb3be0fbd tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:27.284448 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c5e9b49-de6a-4afa-bddc-8a6cb3be0fbd tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:27.284893 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c5e9b49-de6a-4afa-bddc-8a6cb3be0fbd tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:27.285653 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c5e9b49-de6a-4afa-bddc-8a6cb3be0fbd tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:27.286089 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c5e9b49-de6a-4afa-bddc-8a6cb3be0fbd tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:27.399174 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-23e414f8-140a-441d-a58e-910efb85a54e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:27.399827 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-23e414f8-140a-441d-a58e-910efb85a54e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:27.406523 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-23e414f8-140a-441d-a58e-910efb85a54e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:27.406912 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-23e414f8-140a-441d-a58e-910efb85a54e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:27.407716 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-23e414f8-140a-441d-a58e-910efb85a54e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:27.408675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-23e414f8-140a-441d-a58e-910efb85a54e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:27.416388 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1c5e9b49-de6a-4afa-bddc-8a6cb3be0fbd tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:27.424954 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1c5e9b49-de6a-4afa-bddc-8a6cb3be0fbd tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1573 microversion: 2.1 time: 0.152181 Jun 24 08:48:27.433119 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 377/729] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:27 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:27.472792 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-23e414f8-140a-441d-a58e-910efb85a54e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:27.480139 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-23e414f8-140a-441d-a58e-910efb85a54e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1192 microversion: 2.1 time: 0.084779 Jun 24 08:48:27.480733 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 353/730] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:27 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:27.969650 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-81d218bd-99af-4372-974d-9e917a9da09a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:27.970264 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-81d218bd-99af-4372-974d-9e917a9da09a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:27.976919 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81d218bd-99af-4372-974d-9e917a9da09a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:27.977400 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81d218bd-99af-4372-974d-9e917a9da09a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:27.978283 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81d218bd-99af-4372-974d-9e917a9da09a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:27.978816 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81d218bd-99af-4372-974d-9e917a9da09a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:28.105809 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-81d218bd-99af-4372-974d-9e917a9da09a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:28.113844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-81d218bd-99af-4372-974d-9e917a9da09a tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1687 microversion: 2.1 time: 0.148039 Jun 24 08:48:28.114405 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 378/731] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:27 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1687 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:28.442087 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5591f155-793a-45ec-b03a-0f21d262997e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:28.442729 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5591f155-793a-45ec-b03a-0f21d262997e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:28.449055 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5591f155-793a-45ec-b03a-0f21d262997e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:28.449499 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5591f155-793a-45ec-b03a-0f21d262997e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:28.450257 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5591f155-793a-45ec-b03a-0f21d262997e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:28.450685 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5591f155-793a-45ec-b03a-0f21d262997e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:28.496925 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4f152aa6-d397-4f4a-8f4e-6f64f3e3fcb2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:28.497575 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4f152aa6-d397-4f4a-8f4e-6f64f3e3fcb2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:28.503796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4f152aa6-d397-4f4a-8f4e-6f64f3e3fcb2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:28.504331 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4f152aa6-d397-4f4a-8f4e-6f64f3e3fcb2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:28.505107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4f152aa6-d397-4f4a-8f4e-6f64f3e3fcb2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:28.505543 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4f152aa6-d397-4f4a-8f4e-6f64f3e3fcb2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:28.583017 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4f152aa6-d397-4f4a-8f4e-6f64f3e3fcb2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:28.590852 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4f152aa6-d397-4f4a-8f4e-6f64f3e3fcb2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1192 microversion: 2.1 time: 0.097888 Jun 24 08:48:28.591749 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 379/732] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:28 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:28.611349 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5591f155-793a-45ec-b03a-0f21d262997e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:28.618812 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5591f155-793a-45ec-b03a-0f21d262997e tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1573 microversion: 2.1 time: 0.180687 Jun 24 08:48:28.619401 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 354/733] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:28 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1573 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:29.131507 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0d7e67f8-35db-4692-acf5-03ed0dad9734 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:29.132121 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0d7e67f8-35db-4692-acf5-03ed0dad9734 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:29.138150 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0d7e67f8-35db-4692-acf5-03ed0dad9734 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:29.138624 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0d7e67f8-35db-4692-acf5-03ed0dad9734 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:29.139412 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0d7e67f8-35db-4692-acf5-03ed0dad9734 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:29.139845 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0d7e67f8-35db-4692-acf5-03ed0dad9734 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:29.263335 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0d7e67f8-35db-4692-acf5-03ed0dad9734 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:29.270660 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0d7e67f8-35db-4692-acf5-03ed0dad9734 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1687 microversion: 2.1 time: 0.143735 Jun 24 08:48:29.271229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 380/734] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:29 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1687 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:29.607699 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-44eba1b1-5042-4c80-820e-0e49e5daf0a1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:29.608318 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-44eba1b1-5042-4c80-820e-0e49e5daf0a1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:29.615420 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44eba1b1-5042-4c80-820e-0e49e5daf0a1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:29.615870 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44eba1b1-5042-4c80-820e-0e49e5daf0a1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:29.616626 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44eba1b1-5042-4c80-820e-0e49e5daf0a1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:29.617061 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44eba1b1-5042-4c80-820e-0e49e5daf0a1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:29.635912 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-dcd8afba-0b81-49cd-993d-7bd959ffcb39 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:29.636578 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-dcd8afba-0b81-49cd-993d-7bd959ffcb39 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:29.642496 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dcd8afba-0b81-49cd-993d-7bd959ffcb39 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:29.642936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dcd8afba-0b81-49cd-993d-7bd959ffcb39 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:29.643725 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dcd8afba-0b81-49cd-993d-7bd959ffcb39 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:29.644155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dcd8afba-0b81-49cd-993d-7bd959ffcb39 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:29.678262 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-44eba1b1-5042-4c80-820e-0e49e5daf0a1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:29.685702 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-44eba1b1-5042-4c80-820e-0e49e5daf0a1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1192 microversion: 2.1 time: 0.081845 Jun 24 08:48:29.686296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 355/735] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:29 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:29.774152 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-dcd8afba-0b81-49cd-993d-7bd959ffcb39 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:29.781473 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-dcd8afba-0b81-49cd-993d-7bd959ffcb39 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1573 microversion: 2.1 time: 0.149385 Jun 24 08:48:29.782030 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 381/736] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:29 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:30.010156 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-3d65894e-70b8-48f8-87c3-503b10074d0e req-2fd9c4b8-44c6-4cd6-8b44-e124f012a345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73106291-ded8-47c4-8b9f-6ee2c7fe3926", "name": "network-vif-plugged", "status": "completed", "tag": "431156a0-7086-4030-a88f-b4d0acbdcfb2"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:30.018779 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3d65894e-70b8-48f8-87c3-503b10074d0e req-2fd9c4b8-44c6-4cd6-8b44-e124f012a345 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:30.019237 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3d65894e-70b8-48f8-87c3-503b10074d0e req-2fd9c4b8-44c6-4cd6-8b44-e124f012a345 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:30.029941 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-3d65894e-70b8-48f8-87c3-503b10074d0e req-2fd9c4b8-44c6-4cd6-8b44-e124f012a345 service nova] Creating event network-vif-plugged:431156a0-7086-4030-a88f-b4d0acbdcfb2 for instance 73106291-ded8-47c4-8b9f-6ee2c7fe3926 on hv-cinder-84517 Jun 24 08:48:30.035566 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-3d65894e-70b8-48f8-87c3-503b10074d0e req-2fd9c4b8-44c6-4cd6-8b44-e124f012a345 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029035 Jun 24 08:48:30.036191 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 356/737] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:30.287713 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bffca98e-6ce6-4f0e-97d8-600f7b6f4381 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:30.288241 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bffca98e-6ce6-4f0e-97d8-600f7b6f4381 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:30.294167 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bffca98e-6ce6-4f0e-97d8-600f7b6f4381 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:30.294609 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bffca98e-6ce6-4f0e-97d8-600f7b6f4381 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:30.295393 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bffca98e-6ce6-4f0e-97d8-600f7b6f4381 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:30.295820 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bffca98e-6ce6-4f0e-97d8-600f7b6f4381 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:30.426400 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bffca98e-6ce6-4f0e-97d8-600f7b6f4381 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:30.433782 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bffca98e-6ce6-4f0e-97d8-600f7b6f4381 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1687 microversion: 2.1 time: 0.149963 Jun 24 08:48:30.434338 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 382/738] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:30 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:30.704420 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c7d8c2f5-23c3-48ae-94a8-d734126149ff tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:30.705460 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c7d8c2f5-23c3-48ae-94a8-d734126149ff tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:30.712606 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7d8c2f5-23c3-48ae-94a8-d734126149ff tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:30.713050 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7d8c2f5-23c3-48ae-94a8-d734126149ff tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:30.713798 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7d8c2f5-23c3-48ae-94a8-d734126149ff tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:30.714228 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7d8c2f5-23c3-48ae-94a8-d734126149ff tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:30.774415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c7d8c2f5-23c3-48ae-94a8-d734126149ff tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:30.781639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c7d8c2f5-23c3-48ae-94a8-d734126149ff tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1192 microversion: 2.1 time: 0.083093 Jun 24 08:48:30.782192 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 357/739] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:30 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:30.797907 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-86636b8e-4de3-429d-b10d-64edc4de5685 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:30.799020 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-86636b8e-4de3-429d-b10d-64edc4de5685 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:30.804974 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-86636b8e-4de3-429d-b10d-64edc4de5685 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:30.805416 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-86636b8e-4de3-429d-b10d-64edc4de5685 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:30.806172 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-86636b8e-4de3-429d-b10d-64edc4de5685 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:30.806604 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-86636b8e-4de3-429d-b10d-64edc4de5685 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:30.935361 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-86636b8e-4de3-429d-b10d-64edc4de5685 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:30.942944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-86636b8e-4de3-429d-b10d-64edc4de5685 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1560 microversion: 2.1 time: 0.149112 Jun 24 08:48:30.943540 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 383/740] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:30 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:31.451411 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-efdb410d-6c57-41ed-97f1-5f924220c923 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:31.452406 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-efdb410d-6c57-41ed-97f1-5f924220c923 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:31.459005 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efdb410d-6c57-41ed-97f1-5f924220c923 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:31.459482 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efdb410d-6c57-41ed-97f1-5f924220c923 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:31.460595 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efdb410d-6c57-41ed-97f1-5f924220c923 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:31.460719 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-efdb410d-6c57-41ed-97f1-5f924220c923 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:31.600502 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-efdb410d-6c57-41ed-97f1-5f924220c923 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:31.607970 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-efdb410d-6c57-41ed-97f1-5f924220c923 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1687 microversion: 2.1 time: 0.160384 Jun 24 08:48:31.608469 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 358/741] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:31 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:31.798243 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-23beccb0-5b0a-4725-b6bc-ca3fb864abbd tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:31.799441 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-23beccb0-5b0a-4725-b6bc-ca3fb864abbd tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:31.805766 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23beccb0-5b0a-4725-b6bc-ca3fb864abbd tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:31.806245 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23beccb0-5b0a-4725-b6bc-ca3fb864abbd tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:31.807039 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23beccb0-5b0a-4725-b6bc-ca3fb864abbd tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:31.807509 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23beccb0-5b0a-4725-b6bc-ca3fb864abbd tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:31.872584 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-23beccb0-5b0a-4725-b6bc-ca3fb864abbd tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:31.876133 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:31.881179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-23beccb0-5b0a-4725-b6bc-ca3fb864abbd tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1210 microversion: 2.1 time: 0.087087 Jun 24 08:48:31.881738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 384/742] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:31 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:32.626159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-117c07a6-dc21-4ecc-b4ad-07c2380e99b5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:32.627409 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-117c07a6-dc21-4ecc-b4ad-07c2380e99b5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:32.634431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-117c07a6-dc21-4ecc-b4ad-07c2380e99b5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:32.634922 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-117c07a6-dc21-4ecc-b4ad-07c2380e99b5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:32.635755 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-117c07a6-dc21-4ecc-b4ad-07c2380e99b5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:32.636242 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-117c07a6-dc21-4ecc-b4ad-07c2380e99b5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:32.698620 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-117c07a6-dc21-4ecc-b4ad-07c2380e99b5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:32.707327 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-117c07a6-dc21-4ecc-b4ad-07c2380e99b5 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 200 len: 1619 microversion: 2.1 time: 0.085287 Jun 24 08:48:32.708653 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 359/743] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:32 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 1619 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:32.831187 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-b1064011-0f58-492c-b338-fa6f29043bd7 req-25069341-968b-4c21-bab8-68da4470a0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9a15b4-2e8f-47c3-88f1-95b5c4755c92", "name": "network-vif-deleted", "tag": "2a1e43f9-7be3-4e9c-9137-a737077baa15"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:32.844016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-b1064011-0f58-492c-b338-fa6f29043bd7 req-25069341-968b-4c21-bab8-68da4470a0ed service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:32.844544 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-b1064011-0f58-492c-b338-fa6f29043bd7 req-25069341-968b-4c21-bab8-68da4470a0ed service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:32.880482 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-b1064011-0f58-492c-b338-fa6f29043bd7 req-25069341-968b-4c21-bab8-68da4470a0ed service nova] Creating event network-vif-deleted:2a1e43f9-7be3-4e9c-9137-a737077baa15 for instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 on hv-cinder-84517 Jun 24 08:48:32.887684 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-b1064011-0f58-492c-b338-fa6f29043bd7 req-25069341-968b-4c21-bab8-68da4470a0ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062984 Jun 24 08:48:32.888710 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 385/744] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:32.897921 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9d5015f4-7faf-430c-bd84-8d857037cfac tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:32.898544 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9d5015f4-7faf-430c-bd84-8d857037cfac tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:32.910420 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9d5015f4-7faf-430c-bd84-8d857037cfac tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:32.911384 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9d5015f4-7faf-430c-bd84-8d857037cfac tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:32.912359 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9d5015f4-7faf-430c-bd84-8d857037cfac tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:32.912962 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9d5015f4-7faf-430c-bd84-8d857037cfac tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:32.948892 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=100 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:33.090996 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9d5015f4-7faf-430c-bd84-8d857037cfac tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:33.099969 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9d5015f4-7faf-430c-bd84-8d857037cfac tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.205781 Jun 24 08:48:33.101038 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 360/745] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:32 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:33.727381 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e04cca92-b2ef-4a54-a6f4-3f51da893c0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:33.728314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e04cca92-b2ef-4a54-a6f4-3f51da893c0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:33.735773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e04cca92-b2ef-4a54-a6f4-3f51da893c0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:33.736753 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e04cca92-b2ef-4a54-a6f4-3f51da893c0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:33.737541 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e04cca92-b2ef-4a54-a6f4-3f51da893c0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:33.737983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e04cca92-b2ef-4a54-a6f4-3f51da893c0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:33.765597 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-e04cca92-b2ef-4a54-a6f4-3f51da893c0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] HTTP exception thrown: Instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 could not be found. Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e04cca92-b2ef-4a54-a6f4-3f51da893c0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Request method failure captured: Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 HTTP/1.1 Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXjCaDzQeeAS88pmIEoV75NGz1sj1VFNBYsQJRSIP7bTwhkvZVmMob71ZMhhz0MXKI4QBKEgB9PxOXzRd6Lsfc6ptuzcRWEP10RAhAFSAn27e_oFtPDU9vYOeHa8F7uXDn7JXFYCPp0Sf9ACgzg56ujtHpiUhbgtlC9s0ZP50y_R5v0 Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: edde4704253a4439bd7ca50b26e24e40 Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:48:33.767082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:48:33.768840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_edde4704253a4439bd7ca50b26e24e40", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:48:33.768840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:48:33.768840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: edde4704253a4439bd7ca50b26e24e40 Jun 24 08:48:33.768840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:48:33.768840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-ServerRescueNegativeTestJSON-633414902-project Jun 24 08:48:33.768840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:48:33.768840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:48:33.768840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 9abdce8004e24e81bd88bee757d8ec93 Jun 24 08:48:33.768840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-ServerRescueNegativeTestJSON-633414902-project Jun 24 08:48:33.768840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:48:33.768840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 could not be found. Jun 24 08:48:33.768840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '0d9a15b4-2e8f-47c3-88f1-95b5c4755c92'} Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 could not be found. Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:48:33.769768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 could not be found. Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 could not be found. Jun 24 08:48:33.771360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:33.774407 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e04cca92-b2ef-4a54-a6f4-3f51da893c0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Returning 404 to user: Instance 0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:48:33.775591 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e04cca92-b2ef-4a54-a6f4-3f51da893c0b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92" status: 404 len: 111 microversion: 2.1 time: 0.054265 Jun 24 08:48:33.776358 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 386/746] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:33 2022] GET /compute/v2.1/servers/0d9a15b4-2e8f-47c3-88f1-95b5c4755c92 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:48:33.785663 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-af15a736-bad9-4df6-9115-cb8f797ac5c6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '.version_select at 0x7fb75c9ff310>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:33.810223 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-af15a736-bad9-4df6-9115-cb8f797ac5c6 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-39015232" status: 202 len: 0 microversion: 2.1 time: 0.028712 Jun 24 08:48:33.816219 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 361/747] 10.222.0.43 () {58 vars in 1214 bytes} [Fri Jun 24 08:48:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-39015232 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:48:34.119099 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-39b32b73-bdcc-4a39-9af7-28d4e228efe2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:34.119765 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-39b32b73-bdcc-4a39-9af7-28d4e228efe2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:34.126008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-39b32b73-bdcc-4a39-9af7-28d4e228efe2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:34.126455 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-39b32b73-bdcc-4a39-9af7-28d4e228efe2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:34.127279 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-39b32b73-bdcc-4a39-9af7-28d4e228efe2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:34.127890 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-39b32b73-bdcc-4a39-9af7-28d4e228efe2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:34.332166 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-39b32b73-bdcc-4a39-9af7-28d4e228efe2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:34.346480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-39b32b73-bdcc-4a39-9af7-28d4e228efe2 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.231269 Jun 24 08:48:34.347370 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 387/748] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:34 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:34.909642 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-1b85a1f0-d85d-4e59-acd8-20b1c50a6947 req-35abdbf1-b292-43d3-a877-f42678c3aadf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c15d41a9-3945-4a86-9819-9aa482844185", "tag": "a9e44c39-bcf3-4487-bdfd-a74976023909"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:34.918795 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-1b85a1f0-d85d-4e59-acd8-20b1c50a6947 req-35abdbf1-b292-43d3-a877-f42678c3aadf service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:34.919256 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-1b85a1f0-d85d-4e59-acd8-20b1c50a6947 req-35abdbf1-b292-43d3-a877-f42678c3aadf service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:34.930403 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-1b85a1f0-d85d-4e59-acd8-20b1c50a6947 req-35abdbf1-b292-43d3-a877-f42678c3aadf service nova] Creating event network-changed:a9e44c39-bcf3-4487-bdfd-a74976023909 for instance c15d41a9-3945-4a86-9819-9aa482844185 on hv-cinder-84517 Jun 24 08:48:34.935392 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-1b85a1f0-d85d-4e59-acd8-20b1c50a6947 req-35abdbf1-b292-43d3-a877-f42678c3aadf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029452 Jun 24 08:48:34.935966 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 362/749] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:35.363694 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-56847f84-8d55-4602-b865-902ad6f16dd3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:35.364329 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-56847f84-8d55-4602-b865-902ad6f16dd3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:35.366291 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:35.371846 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-56847f84-8d55-4602-b865-902ad6f16dd3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:35.372289 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-56847f84-8d55-4602-b865-902ad6f16dd3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:35.373096 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-56847f84-8d55-4602-b865-902ad6f16dd3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:35.373457 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-56847f84-8d55-4602-b865-902ad6f16dd3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:35.505447 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-56847f84-8d55-4602-b865-902ad6f16dd3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:35.512916 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-56847f84-8d55-4602-b865-902ad6f16dd3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.153699 Jun 24 08:48:35.513466 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 388/750] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:35 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:36.526413 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:36.527121 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:36.531990 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-525e3945-3b72-4aef-bdaa-96ba5198b83f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:36.532717 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-525e3945-3b72-4aef-bdaa-96ba5198b83f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:36.539760 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-525e3945-3b72-4aef-bdaa-96ba5198b83f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:36.540218 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-525e3945-3b72-4aef-bdaa-96ba5198b83f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:36.540985 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-525e3945-3b72-4aef-bdaa-96ba5198b83f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:36.541432 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-525e3945-3b72-4aef-bdaa-96ba5198b83f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:36.669755 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-525e3945-3b72-4aef-bdaa-96ba5198b83f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:36.677839 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-525e3945-3b72-4aef-bdaa-96ba5198b83f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.152457 Jun 24 08:48:36.678409 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 363/751] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:36 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:36.823202 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-feebf70e-6100-48b4-a124-ec77577f4028 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:36.823720 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-feebf70e-6100-48b4-a124-ec77577f4028 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:36.829770 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-feebf70e-6100-48b4-a124-ec77577f4028 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:36.830220 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-feebf70e-6100-48b4-a124-ec77577f4028 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:36.830972 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-feebf70e-6100-48b4-a124-ec77577f4028 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:36.831435 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-feebf70e-6100-48b4-a124-ec77577f4028 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:36.855591 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-feebf70e-6100-48b4-a124-ec77577f4028 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:48:36.928913 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-feebf70e-6100-48b4-a124-ec77577f4028 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 204 len: 0 microversion: 2.1 time: 0.109126 Jun 24 08:48:36.929568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 389/752] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:48:36 2022] DELETE /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:48:36.938093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1c759f85-854f-4af8-a401-93b05057d64e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:36.938738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1c759f85-854f-4af8-a401-93b05057d64e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:36.944794 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1c759f85-854f-4af8-a401-93b05057d64e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:36.945248 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1c759f85-854f-4af8-a401-93b05057d64e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:36.946015 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1c759f85-854f-4af8-a401-93b05057d64e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:36.946453 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1c759f85-854f-4af8-a401-93b05057d64e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:37.073960 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1c759f85-854f-4af8-a401-93b05057d64e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:37.082028 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1c759f85-854f-4af8-a401-93b05057d64e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1505 microversion: 2.1 time: 0.147790 Jun 24 08:48:37.082794 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 364/753] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:36 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:37.695437 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e88c4b63-72f1-4767-8757-5e6b23729254 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:37.696130 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e88c4b63-72f1-4767-8757-5e6b23729254 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:37.702102 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e88c4b63-72f1-4767-8757-5e6b23729254 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:37.702540 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e88c4b63-72f1-4767-8757-5e6b23729254 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:37.703314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e88c4b63-72f1-4767-8757-5e6b23729254 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:37.703742 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e88c4b63-72f1-4767-8757-5e6b23729254 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:37.832993 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e88c4b63-72f1-4767-8757-5e6b23729254 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:37.840426 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e88c4b63-72f1-4767-8757-5e6b23729254 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.149251 Jun 24 08:48:37.840994 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 390/754] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:37 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:38.100297 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8f02b7ee-96a3-4ff6-a68a-00cacd9e2031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:38.100915 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8f02b7ee-96a3-4ff6-a68a-00cacd9e2031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:38.107334 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8f02b7ee-96a3-4ff6-a68a-00cacd9e2031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:38.107785 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8f02b7ee-96a3-4ff6-a68a-00cacd9e2031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:38.108558 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8f02b7ee-96a3-4ff6-a68a-00cacd9e2031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:38.109051 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8f02b7ee-96a3-4ff6-a68a-00cacd9e2031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:38.171697 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8f02b7ee-96a3-4ff6-a68a-00cacd9e2031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:38.181779 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8f02b7ee-96a3-4ff6-a68a-00cacd9e2031 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 200 len: 1463 microversion: 2.1 time: 0.085263 Jun 24 08:48:38.191643 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 365/755] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:38 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 1463 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:38.240983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-c03a32e0-117b-402c-bd36-071870e63be2 req-1ca5b2af-ef22-447e-b466-9590de1d8511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b5105a-20c5-4e33-b0d8-74b5033b5c38", "name": "network-vif-deleted", "tag": "0c02d8f2-b51b-4f5e-a580-5a4e41ddb70b"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:38.251385 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-c03a32e0-117b-402c-bd36-071870e63be2 req-1ca5b2af-ef22-447e-b466-9590de1d8511 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:38.252387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-c03a32e0-117b-402c-bd36-071870e63be2 req-1ca5b2af-ef22-447e-b466-9590de1d8511 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:38.264250 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-c03a32e0-117b-402c-bd36-071870e63be2 req-1ca5b2af-ef22-447e-b466-9590de1d8511 service nova] Creating event network-vif-deleted:0c02d8f2-b51b-4f5e-a580-5a4e41ddb70b for instance b1b5105a-20c5-4e33-b0d8-74b5033b5c38 on hv-cinder-84517 Jun 24 08:48:38.273405 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-c03a32e0-117b-402c-bd36-071870e63be2 req-1ca5b2af-ef22-447e-b466-9590de1d8511 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038081 Jun 24 08:48:38.274020 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 391/756] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:38.856613 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-72ab0364-fef3-4227-94f6-59c205da5e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:38.857223 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-72ab0364-fef3-4227-94f6-59c205da5e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:38.863715 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-72ab0364-fef3-4227-94f6-59c205da5e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:38.864161 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-72ab0364-fef3-4227-94f6-59c205da5e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:38.864925 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-72ab0364-fef3-4227-94f6-59c205da5e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:38.865359 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-72ab0364-fef3-4227-94f6-59c205da5e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:38.995887 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-72ab0364-fef3-4227-94f6-59c205da5e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:39.003223 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-72ab0364-fef3-4227-94f6-59c205da5e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.150506 Jun 24 08:48:39.003774 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 366/757] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:38 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:39.198891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-93a286ff-d287-4e9b-a85b-ed6c37fbc352 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:39.199611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-93a286ff-d287-4e9b-a85b-ed6c37fbc352 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: b1b5105a-20c5-4e33-b0d8-74b5033b5c38] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:39.206423 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-93a286ff-d287-4e9b-a85b-ed6c37fbc352 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:39.206858 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-93a286ff-d287-4e9b-a85b-ed6c37fbc352 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:39.207793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-93a286ff-d287-4e9b-a85b-ed6c37fbc352 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:39.208225 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-93a286ff-d287-4e9b-a85b-ed6c37fbc352 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:39.220862 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-93a286ff-d287-4e9b-a85b-ed6c37fbc352 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] HTTP exception thrown: Instance b1b5105a-20c5-4e33-b0d8-74b5033b5c38 could not be found. Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-93a286ff-d287-4e9b-a85b-ed6c37fbc352 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Request method failure captured: Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 HTTP/1.1 Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXjCaDzQeeAS88pmIEoV75NGz1sj1VFNBYsQJRSIP7bTwhkvZVmMob71ZMhhz0MXKI4QBKEgB9PxOXzRd6Lsfc6ptuzcRWEP10RAhAFSAn27e_oFtPDU9vYOeHa8F7uXDn7JXFYCPp0Sf9ACgzg56ujtHpiUhbgtlC9s0ZP50y_R5v0 Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: edde4704253a4439bd7ca50b26e24e40 Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:48:39.222487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:48:39.224025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_edde4704253a4439bd7ca50b26e24e40", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:48:39.224025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:48:39.224025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: edde4704253a4439bd7ca50b26e24e40 Jun 24 08:48:39.224025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:48:39.224025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-ServerRescueNegativeTestJSON-633414902-project Jun 24 08:48:39.224025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:48:39.224025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:48:39.224025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 9abdce8004e24e81bd88bee757d8ec93 Jun 24 08:48:39.224025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-ServerRescueNegativeTestJSON-633414902-project Jun 24 08:48:39.224025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:48:39.224025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance b1b5105a-20c5-4e33-b0d8-74b5033b5c38 could not be found. Jun 24 08:48:39.224025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': 'b1b5105a-20c5-4e33-b0d8-74b5033b5c38'} Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1b5105a-20c5-4e33-b0d8-74b5033b5c38 could not be found. Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:48:39.224898 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1b5105a-20c5-4e33-b0d8-74b5033b5c38 could not be found. Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1b5105a-20c5-4e33-b0d8-74b5033b5c38 could not be found. Jun 24 08:48:39.226336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:48:39.227788 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-93a286ff-d287-4e9b-a85b-ed6c37fbc352 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Returning 404 to user: Instance b1b5105a-20c5-4e33-b0d8-74b5033b5c38 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:48:39.227788 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-93a286ff-d287-4e9b-a85b-ed6c37fbc352 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38" status: 404 len: 111 microversion: 2.1 time: 0.029261 Jun 24 08:48:39.227788 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 392/758] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:39 2022] GET /compute/v2.1/servers/b1b5105a-20c5-4e33-b0d8-74b5033b5c38 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:48:39.232387 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-09563b00-0bcb-447e-b4c2-b76ee2a973fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:39.232884 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-09563b00-0bcb-447e-b4c2-b76ee2a973fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:39.239340 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09563b00-0bcb-447e-b4c2-b76ee2a973fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:39.239792 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09563b00-0bcb-447e-b4c2-b76ee2a973fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:39.240551 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09563b00-0bcb-447e-b4c2-b76ee2a973fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:39.240984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-09563b00-0bcb-447e-b4c2-b76ee2a973fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:39.265630 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-09563b00-0bcb-447e-b4c2-b76ee2a973fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:48:39.345016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-09563b00-0bcb-447e-b4c2-b76ee2a973fb tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 204 len: 0 microversion: 2.1 time: 0.116183 Jun 24 08:48:39.346613 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 367/759] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:48:39 2022] DELETE /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:48:39.354414 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8a371aa7-0d70-4dcf-941e-aebf09820e53 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:39.355026 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8a371aa7-0d70-4dcf-941e-aebf09820e53 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:39.361085 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8a371aa7-0d70-4dcf-941e-aebf09820e53 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:39.361531 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8a371aa7-0d70-4dcf-941e-aebf09820e53 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:39.362285 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8a371aa7-0d70-4dcf-941e-aebf09820e53 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:39.362718 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8a371aa7-0d70-4dcf-941e-aebf09820e53 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:39.489636 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8a371aa7-0d70-4dcf-941e-aebf09820e53 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:39.497033 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8a371aa7-0d70-4dcf-941e-aebf09820e53 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.146474 Jun 24 08:48:39.497598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 393/760] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:39 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:40.019782 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2d5295be-9e4b-4a8d-b621-320c3e22122a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:40.020515 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2d5295be-9e4b-4a8d-b621-320c3e22122a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:40.026422 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d5295be-9e4b-4a8d-b621-320c3e22122a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:40.026871 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d5295be-9e4b-4a8d-b621-320c3e22122a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:40.027664 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d5295be-9e4b-4a8d-b621-320c3e22122a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:40.028100 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d5295be-9e4b-4a8d-b621-320c3e22122a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:40.160520 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2d5295be-9e4b-4a8d-b621-320c3e22122a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:40.168230 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2d5295be-9e4b-4a8d-b621-320c3e22122a tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.152617 Jun 24 08:48:40.168827 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 368/761] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:40 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:40.514211 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-daee4152-2764-4ce5-b22a-a6838248b12e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:40.514817 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-daee4152-2764-4ce5-b22a-a6838248b12e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:40.521327 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-daee4152-2764-4ce5-b22a-a6838248b12e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:40.521774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-daee4152-2764-4ce5-b22a-a6838248b12e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:40.522531 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-daee4152-2764-4ce5-b22a-a6838248b12e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:40.522967 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-daee4152-2764-4ce5-b22a-a6838248b12e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:40.647407 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-daee4152-2764-4ce5-b22a-a6838248b12e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:40.654698 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-daee4152-2764-4ce5-b22a-a6838248b12e tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.144472 Jun 24 08:48:40.655272 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 394/762] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:40 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:41.185964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5774a7d2-0415-40cc-9a78-a7be3c8563c9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:41.186572 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5774a7d2-0415-40cc-9a78-a7be3c8563c9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:41.193199 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5774a7d2-0415-40cc-9a78-a7be3c8563c9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:41.193639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5774a7d2-0415-40cc-9a78-a7be3c8563c9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:41.194387 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5774a7d2-0415-40cc-9a78-a7be3c8563c9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:41.194816 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5774a7d2-0415-40cc-9a78-a7be3c8563c9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:41.322732 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5774a7d2-0415-40cc-9a78-a7be3c8563c9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:41.330079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5774a7d2-0415-40cc-9a78-a7be3c8563c9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.148082 Jun 24 08:48:41.330636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 369/763] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:41 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:41.671967 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7ade9dfc-0b26-47bf-99b1-3c3affa7b4de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:41.672841 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7ade9dfc-0b26-47bf-99b1-3c3affa7b4de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:41.678818 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7ade9dfc-0b26-47bf-99b1-3c3affa7b4de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:41.679295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7ade9dfc-0b26-47bf-99b1-3c3affa7b4de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:41.680055 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7ade9dfc-0b26-47bf-99b1-3c3affa7b4de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:41.680490 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7ade9dfc-0b26-47bf-99b1-3c3affa7b4de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:41.810538 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7ade9dfc-0b26-47bf-99b1-3c3affa7b4de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:41.817866 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7ade9dfc-0b26-47bf-99b1-3c3affa7b4de tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.149744 Jun 24 08:48:41.818420 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 395/764] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:41 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:42.347591 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2e013117-ddb7-4d47-af13-5f53bcea36a7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:42.348208 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2e013117-ddb7-4d47-af13-5f53bcea36a7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:42.354634 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2e013117-ddb7-4d47-af13-5f53bcea36a7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:42.355084 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2e013117-ddb7-4d47-af13-5f53bcea36a7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:42.355873 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2e013117-ddb7-4d47-af13-5f53bcea36a7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:42.356306 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2e013117-ddb7-4d47-af13-5f53bcea36a7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:42.483751 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2e013117-ddb7-4d47-af13-5f53bcea36a7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:42.491036 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2e013117-ddb7-4d47-af13-5f53bcea36a7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.147830 Jun 24 08:48:42.491632 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 370/765] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:42 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:42.834207 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-59dafce3-18e7-47be-9c83-35b09a7b8254 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:42.834815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-59dafce3-18e7-47be-9c83-35b09a7b8254 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:42.840764 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59dafce3-18e7-47be-9c83-35b09a7b8254 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:42.841206 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59dafce3-18e7-47be-9c83-35b09a7b8254 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:42.841952 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59dafce3-18e7-47be-9c83-35b09a7b8254 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:42.842378 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-59dafce3-18e7-47be-9c83-35b09a7b8254 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:42.969587 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-59dafce3-18e7-47be-9c83-35b09a7b8254 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:42.976866 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-59dafce3-18e7-47be-9c83-35b09a7b8254 tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1521 microversion: 2.1 time: 0.147029 Jun 24 08:48:42.977447 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 396/766] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:42 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:43.508219 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3850bcfc-9dc3-4a5d-9fc7-7f364335de57 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:43.508977 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3850bcfc-9dc3-4a5d-9fc7-7f364335de57 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:43.515359 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3850bcfc-9dc3-4a5d-9fc7-7f364335de57 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:43.515807 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3850bcfc-9dc3-4a5d-9fc7-7f364335de57 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:43.516567 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3850bcfc-9dc3-4a5d-9fc7-7f364335de57 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:43.516999 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3850bcfc-9dc3-4a5d-9fc7-7f364335de57 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:43.645861 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3850bcfc-9dc3-4a5d-9fc7-7f364335de57 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:43.654223 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3850bcfc-9dc3-4a5d-9fc7-7f364335de57 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.149867 Jun 24 08:48:43.654827 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 371/767] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:43 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:43.768878 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-f613e7a8-0710-4747-981d-4630ae774d7a req-f3a3d130-9d6c-4214-a828-9aaede6fc182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9", "name": "network-vif-deleted", "tag": "b4f1fb4a-3774-4faf-a4f3-7df9149cb8e7"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:43.777333 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-f613e7a8-0710-4747-981d-4630ae774d7a req-f3a3d130-9d6c-4214-a828-9aaede6fc182 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:43.777766 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-f613e7a8-0710-4747-981d-4630ae774d7a req-f3a3d130-9d6c-4214-a828-9aaede6fc182 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:43.790400 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-f613e7a8-0710-4747-981d-4630ae774d7a req-f3a3d130-9d6c-4214-a828-9aaede6fc182 service nova] Creating event network-vif-deleted:b4f1fb4a-3774-4faf-a4f3-7df9149cb8e7 for instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 on hv-cinder-84517 Jun 24 08:48:43.795041 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-f613e7a8-0710-4747-981d-4630ae774d7a req-f3a3d130-9d6c-4214-a828-9aaede6fc182 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030011 Jun 24 08:48:43.795689 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 397/768] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:43.993953 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-87659a62-c7d8-469a-b1fa-4941e0e09a1b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:43.994548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-87659a62-c7d8-469a-b1fa-4941e0e09a1b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:44.000452 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87659a62-c7d8-469a-b1fa-4941e0e09a1b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:44.000896 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87659a62-c7d8-469a-b1fa-4941e0e09a1b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:44.001648 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87659a62-c7d8-469a-b1fa-4941e0e09a1b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:44.002078 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87659a62-c7d8-469a-b1fa-4941e0e09a1b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:44.031297 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87659a62-c7d8-469a-b1fa-4941e0e09a1b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:44.031746 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-87659a62-c7d8-469a-b1fa-4941e0e09a1b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:44.032184 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-87659a62-c7d8-469a-b1fa-4941e0e09a1b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lazy-loading 'fault' on Instance uuid 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:48:44.073433 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-87659a62-c7d8-469a-b1fa-4941e0e09a1b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9abdce8004e24e81bd88bee757d8ec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edde4704253a4439bd7ca50b26e24e40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:44.081694 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-87659a62-c7d8-469a-b1fa-4941e0e09a1b tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 200 len: 1311 microversion: 2.1 time: 0.091673 Jun 24 08:48:44.082270 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 372/769] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:43 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:44.672750 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-224e4239-78e1-4265-a351-bc5bbaf57f3e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:44.673439 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-224e4239-78e1-4265-a351-bc5bbaf57f3e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:44.680093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-224e4239-78e1-4265-a351-bc5bbaf57f3e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:44.680529 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-224e4239-78e1-4265-a351-bc5bbaf57f3e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:44.681273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-224e4239-78e1-4265-a351-bc5bbaf57f3e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:44.681699 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-224e4239-78e1-4265-a351-bc5bbaf57f3e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:44.812315 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-224e4239-78e1-4265-a351-bc5bbaf57f3e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:44.820323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-224e4239-78e1-4265-a351-bc5bbaf57f3e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.152270 Jun 24 08:48:44.820876 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 398/770] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:44 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:45.098275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-95270656-8cbc-4633-8c42-10e9da2197be tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:45.098881 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-95270656-8cbc-4633-8c42-10e9da2197be tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] [instance: 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:45.105282 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-95270656-8cbc-4633-8c42-10e9da2197be tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:45.105746 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-95270656-8cbc-4633-8c42-10e9da2197be tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:45.106479 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-95270656-8cbc-4633-8c42-10e9da2197be tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:45.106907 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-95270656-8cbc-4633-8c42-10e9da2197be tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:45.120559 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-95270656-8cbc-4633-8c42-10e9da2197be tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] HTTP exception thrown: Instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 could not be found. Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-95270656-8cbc-4633-8c42-10e9da2197be tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Request method failure captured: Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 HTTP/1.1 Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXjCaDzQeeAS88pmIEoV75NGz1sj1VFNBYsQJRSIP7bTwhkvZVmMob71ZMhhz0MXKI4QBKEgB9PxOXzRd6Lsfc6ptuzcRWEP10RAhAFSAn27e_oFtPDU9vYOeHa8F7uXDn7JXFYCPp0Sf9ACgzg56ujtHpiUhbgtlC9s0ZP50y_R5v0 Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: edde4704253a4439bd7ca50b26e24e40 Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:48:45.122173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:48:45.123766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_edde4704253a4439bd7ca50b26e24e40", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/edde4704253a4439bd7ca50b26e24e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:48:45.123766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:48:45.123766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: edde4704253a4439bd7ca50b26e24e40 Jun 24 08:48:45.123766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-633414902 Jun 24 08:48:45.123766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-ServerRescueNegativeTestJSON-633414902-project Jun 24 08:48:45.123766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:48:45.123766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:48:45.123766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 9abdce8004e24e81bd88bee757d8ec93 Jun 24 08:48:45.123766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-ServerRescueNegativeTestJSON-633414902-project Jun 24 08:48:45.123766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:48:45.123766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 could not be found. Jun 24 08:48:45.123766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': '6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9'} Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 could not be found. Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:48:45.124607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 could not be found. Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 could not be found. Jun 24 08:48:45.126041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:48:45.127500 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-95270656-8cbc-4633-8c42-10e9da2197be tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] Returning 404 to user: Instance 6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:48:45.127500 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-95270656-8cbc-4633-8c42-10e9da2197be tempest-ServerRescueNegativeTestJSON-633414902 tempest-ServerRescueNegativeTestJSON-633414902-project] 10.222.0.43 "GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9" status: 404 len: 111 microversion: 2.1 time: 0.029583 Jun 24 08:48:45.127500 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 373/771] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:45 2022] GET /compute/v2.1/servers/6f6e1d59-1ff7-48e7-85b6-c34f33b2a3d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:48:45.837013 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f85367af-5621-47ac-9adb-c702bb66de86 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:45.837618 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f85367af-5621-47ac-9adb-c702bb66de86 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:45.839725 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:45.845292 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f85367af-5621-47ac-9adb-c702bb66de86 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:45.845744 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f85367af-5621-47ac-9adb-c702bb66de86 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:45.847009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f85367af-5621-47ac-9adb-c702bb66de86 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:45.847476 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f85367af-5621-47ac-9adb-c702bb66de86 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:46.046064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f85367af-5621-47ac-9adb-c702bb66de86 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:46.055552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f85367af-5621-47ac-9adb-c702bb66de86 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.222261 Jun 24 08:48:46.065090 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 399/772] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:45 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:47.072364 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9825e359-e268-4e71-8abd-f2f431c9bbe0 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:47.073587 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9825e359-e268-4e71-8abd-f2f431c9bbe0 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:47.081896 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9825e359-e268-4e71-8abd-f2f431c9bbe0 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:47.082340 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9825e359-e268-4e71-8abd-f2f431c9bbe0 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:47.083117 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9825e359-e268-4e71-8abd-f2f431c9bbe0 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:47.083571 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9825e359-e268-4e71-8abd-f2f431c9bbe0 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:47.234807 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9825e359-e268-4e71-8abd-f2f431c9bbe0 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:47.242676 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9825e359-e268-4e71-8abd-f2f431c9bbe0 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.174307 Jun 24 08:48:47.243248 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 374/773] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:47 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:48.128654 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-5c271ffa-912c-445d-b168-ffd02764c861 req-31458596-7bc5-41dc-bc00-fb7bb1f481d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c15d41a9-3945-4a86-9819-9aa482844185", "name": "network-vif-plugged", "status": "completed", "tag": "a9e44c39-bcf3-4487-bdfd-a74976023909"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:48.141916 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-5c271ffa-912c-445d-b168-ffd02764c861 req-31458596-7bc5-41dc-bc00-fb7bb1f481d9 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:48.142039 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-5c271ffa-912c-445d-b168-ffd02764c861 req-31458596-7bc5-41dc-bc00-fb7bb1f481d9 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:48.174454 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-5c271ffa-912c-445d-b168-ffd02764c861 req-31458596-7bc5-41dc-bc00-fb7bb1f481d9 service nova] Creating event network-vif-plugged:a9e44c39-bcf3-4487-bdfd-a74976023909 for instance c15d41a9-3945-4a86-9819-9aa482844185 on hv-cinder-84517 Jun 24 08:48:48.187569 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-5c271ffa-912c-445d-b168-ffd02764c861 req-31458596-7bc5-41dc-bc00-fb7bb1f481d9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066684 Jun 24 08:48:48.188508 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 400/774] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:48.259311 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1a63e500-ffd8-49d3-9841-0c2a2bc84a25 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:48.259935 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1a63e500-ffd8-49d3-9841-0c2a2bc84a25 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:48.266417 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1a63e500-ffd8-49d3-9841-0c2a2bc84a25 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:48.266867 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1a63e500-ffd8-49d3-9841-0c2a2bc84a25 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:48.267657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1a63e500-ffd8-49d3-9841-0c2a2bc84a25 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:48.268682 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1a63e500-ffd8-49d3-9841-0c2a2bc84a25 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:48.414762 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1a63e500-ffd8-49d3-9841-0c2a2bc84a25 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:48.422197 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1a63e500-ffd8-49d3-9841-0c2a2bc84a25 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.166863 Jun 24 08:48:48.423007 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 375/775] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:48 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:49.440341 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-29ddae6c-a148-4ef1-9757-c3d978240f4c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:49.441071 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-29ddae6c-a148-4ef1-9757-c3d978240f4c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:49.447118 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-29ddae6c-a148-4ef1-9757-c3d978240f4c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:49.447590 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-29ddae6c-a148-4ef1-9757-c3d978240f4c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:49.448343 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-29ddae6c-a148-4ef1-9757-c3d978240f4c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:49.448769 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-29ddae6c-a148-4ef1-9757-c3d978240f4c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:49.626269 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-29ddae6c-a148-4ef1-9757-c3d978240f4c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:49.634228 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-29ddae6c-a148-4ef1-9757-c3d978240f4c tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1266 microversion: 2.1 time: 0.198421 Jun 24 08:48:49.634880 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 401/776] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:49 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:50.652233 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e099d3a0-961f-41fc-98e7-d828e805b3fb tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:50.652977 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e099d3a0-961f-41fc-98e7-d828e805b3fb tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:50.662121 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e099d3a0-961f-41fc-98e7-d828e805b3fb tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:50.663083 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e099d3a0-961f-41fc-98e7-d828e805b3fb tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:50.665203 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e099d3a0-961f-41fc-98e7-d828e805b3fb tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:50.666108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e099d3a0-961f-41fc-98e7-d828e805b3fb tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:50.804306 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e099d3a0-961f-41fc-98e7-d828e805b3fb tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:50.812890 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e099d3a0-961f-41fc-98e7-d828e805b3fb tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1452 microversion: 2.1 time: 0.164989 Jun 24 08:48:50.825476 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 376/777] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:50 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:50.829826 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bcfd3a65-c75a-4b81-afc5-9648f08d101f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:50.830477 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bcfd3a65-c75a-4b81-afc5-9648f08d101f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:50.836610 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bcfd3a65-c75a-4b81-afc5-9648f08d101f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:50.837057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bcfd3a65-c75a-4b81-afc5-9648f08d101f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:50.837819 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bcfd3a65-c75a-4b81-afc5-9648f08d101f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:50.838253 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bcfd3a65-c75a-4b81-afc5-9648f08d101f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:50.982290 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bcfd3a65-c75a-4b81-afc5-9648f08d101f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:50.990675 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bcfd3a65-c75a-4b81-afc5-9648f08d101f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1452 microversion: 2.1 time: 0.164674 Jun 24 08:48:50.991613 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 402/778] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:50 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:53.492239 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-edd90c45-1eab-4b09-a2bb-eb2172566968 req-85f262c8-6890-4b5a-b0fa-1e57ab96d06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c15d41a9-3945-4a86-9819-9aa482844185", "tag": "a9e44c39-bcf3-4487-bdfd-a74976023909"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:53.497138 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:53.524342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-edd90c45-1eab-4b09-a2bb-eb2172566968 req-85f262c8-6890-4b5a-b0fa-1e57ab96d06d service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:53.534590 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-edd90c45-1eab-4b09-a2bb-eb2172566968 req-85f262c8-6890-4b5a-b0fa-1e57ab96d06d service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:53.550278 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-edd90c45-1eab-4b09-a2bb-eb2172566968 req-85f262c8-6890-4b5a-b0fa-1e57ab96d06d service nova] Creating event network-changed:a9e44c39-bcf3-4487-bdfd-a74976023909 for instance c15d41a9-3945-4a86-9819-9aa482844185 on hv-cinder-84517 Jun 24 08:48:53.558139 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-edd90c45-1eab-4b09-a2bb-eb2172566968 req-85f262c8-6890-4b5a-b0fa-1e57ab96d06d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069723 Jun 24 08:48:53.559618 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 377/779] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:54.582996 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e9f0e125-709b-4e11-aeba-3ebcdb35d305 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Action: 'create', calling method: .version_select at 0x7fb75c836e50>, body: {"keypair": {"name": "tempest-keypair-100210827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6ubyvM849L6KzGG0eLzDnwnBAuZ/1PYt4xrE5rG9q2oTMqAZdUVDm8z2hTUmNKQIl/DfuV5F31/RhNF66LAR+x901rJUO8Y50btAipEj44a3tTmevF+J3Re0KRoc6S8w=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:54.597465 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-e9f0e125-709b-4e11-aeba-3ebcdb35d305 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Getting quotas for project f7c692366d8d456ba98167614a0921f0. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:48:54.601872 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-e9f0e125-709b-4e11-aeba-3ebcdb35d305 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Getting quotas for user 063272f0c2054a53b831b35abf405b20 and project f7c692366d8d456ba98167614a0921f0. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:48:54.628043 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e9f0e125-709b-4e11-aeba-3ebcdb35d305 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.165622 Jun 24 08:48:54.628664 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 403/780] 10.222.0.43 () {60 vars in 1158 bytes} [Fri Jun 24 08:48:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:55.948706 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1802849319", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51ff3af8-93b9-4b5c-af0e-0b6a38331957"}], "security_groups": [{"name": "tempest-securitygroup--1112042158"}], "key_name": "tempest-keypair-100210827", "user_data": "}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:56.054219 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] validate_networks() for [('51ff3af8-93b9-4b5c-af0e-0b6a38331957', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:48:56.430889 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:48:56.431474 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:48:56.431944 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:48:56.432545 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:48:56.432960 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:48:56.443033 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:56.443905 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:56.444806 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:56.445336 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:56.452817 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:56.466994 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Getting quotas for project f7c692366d8d456ba98167614a0921f0. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:48:56.472116 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Getting quotas for user 063272f0c2054a53b831b35abf405b20 and project f7c692366d8d456ba98167614a0921f0. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:48:56.484014 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:48:56.486482 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:48:56.534200 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f302865a-d15d-44d7-a3d5-70290b7cbaf1 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.590204 Jun 24 08:48:56.535064 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 378/781] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:48:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:48:56.544835 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ce6d5ec9-67f5-46fe-8848-7a69951c9ef7 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:56.545602 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ce6d5ec9-67f5-46fe-8848-7a69951c9ef7 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:56.621530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ce6d5ec9-67f5-46fe-8848-7a69951c9ef7 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:56.629558 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ce6d5ec9-67f5-46fe-8848-7a69951c9ef7 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1237 microversion: 2.1 time: 0.088132 Jun 24 08:48:56.630678 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 404/782] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:56 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:57.647980 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fb427ad5-8cfe-4ff3-9886-f8ecf4bca6b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:57.648692 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fb427ad5-8cfe-4ff3-9886-f8ecf4bca6b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:57.663668 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb427ad5-8cfe-4ff3-9886-f8ecf4bca6b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:57.664533 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb427ad5-8cfe-4ff3-9886-f8ecf4bca6b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:57.665437 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb427ad5-8cfe-4ff3-9886-f8ecf4bca6b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:57.666127 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fb427ad5-8cfe-4ff3-9886-f8ecf4bca6b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:57.747636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fb427ad5-8cfe-4ff3-9886-f8ecf4bca6b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:57.755339 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fb427ad5-8cfe-4ff3-9886-f8ecf4bca6b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1297 microversion: 2.1 time: 0.112496 Jun 24 08:48:57.756511 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 379/783] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:57 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1297 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:58.773547 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9ecd0e18-6aae-47e6-815d-62d1fd6b1751 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:58.774068 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9ecd0e18-6aae-47e6-815d-62d1fd6b1751 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:58.781137 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9ecd0e18-6aae-47e6-815d-62d1fd6b1751 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:58.781589 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9ecd0e18-6aae-47e6-815d-62d1fd6b1751 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:58.782363 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9ecd0e18-6aae-47e6-815d-62d1fd6b1751 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:58.782803 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9ecd0e18-6aae-47e6-815d-62d1fd6b1751 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:58.911904 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9ecd0e18-6aae-47e6-815d-62d1fd6b1751 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:58.926930 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:58.932548 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9ecd0e18-6aae-47e6-815d-62d1fd6b1751 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1363 microversion: 2.1 time: 0.162908 Jun 24 08:48:58.937714 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 405/784] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:58 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:59.143820 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-816e8d9c-e1c3-47c4-b2cc-9a8a2a7cdd93 req-5861d69a-8893-41df-9066-593270e5e822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77cd8982-eb26-429b-ba63-c8f02412f7c3", "tag": "ac731d01-8032-4238-b050-e3f4a4ae9998"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:59.155329 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-816e8d9c-e1c3-47c4-b2cc-9a8a2a7cdd93 req-5861d69a-8893-41df-9066-593270e5e822 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:59.155897 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-816e8d9c-e1c3-47c4-b2cc-9a8a2a7cdd93 req-5861d69a-8893-41df-9066-593270e5e822 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:59.182189 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-816e8d9c-e1c3-47c4-b2cc-9a8a2a7cdd93 req-5861d69a-8893-41df-9066-593270e5e822 service nova] Creating event network-changed:ac731d01-8032-4238-b050-e3f4a4ae9998 for instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 on hv-cinder-84517 Jun 24 08:48:59.188631 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-816e8d9c-e1c3-47c4-b2cc-9a8a2a7cdd93 req-5861d69a-8893-41df-9066-593270e5e822 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048634 Jun 24 08:48:59.189344 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 380/785] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:59.951127 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-090b9abd-b773-4612-bd7c-0b02bd0f07c0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:59.951908 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-090b9abd-b773-4612-bd7c-0b02bd0f07c0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:59.959164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-090b9abd-b773-4612-bd7c-0b02bd0f07c0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:59.959640 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-090b9abd-b773-4612-bd7c-0b02bd0f07c0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:59.960398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-090b9abd-b773-4612-bd7c-0b02bd0f07c0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:59.960826 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-090b9abd-b773-4612-bd7c-0b02bd0f07c0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:00.091780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-090b9abd-b773-4612-bd7c-0b02bd0f07c0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:00.099753 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-090b9abd-b773-4612-bd7c-0b02bd0f07c0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1363 microversion: 2.1 time: 0.153481 Jun 24 08:49:00.100327 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 406/786] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:59 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:01.118173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-585c9fc4-a8d1-4671-b817-695212d8176c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:01.118872 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-585c9fc4-a8d1-4671-b817-695212d8176c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:01.125055 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-585c9fc4-a8d1-4671-b817-695212d8176c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:01.125512 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-585c9fc4-a8d1-4671-b817-695212d8176c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:01.126271 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-585c9fc4-a8d1-4671-b817-695212d8176c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:01.126707 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-585c9fc4-a8d1-4671-b817-695212d8176c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:01.252858 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-585c9fc4-a8d1-4671-b817-695212d8176c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:01.260146 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-585c9fc4-a8d1-4671-b817-695212d8176c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1363 microversion: 2.1 time: 0.146681 Jun 24 08:49:01.260710 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 381/787] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:01 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:02.277413 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bfe1bcee-8e1a-4b5f-824e-7b21a649b8cf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:02.277930 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bfe1bcee-8e1a-4b5f-824e-7b21a649b8cf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:02.284513 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bfe1bcee-8e1a-4b5f-824e-7b21a649b8cf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:02.284958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bfe1bcee-8e1a-4b5f-824e-7b21a649b8cf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:02.285713 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bfe1bcee-8e1a-4b5f-824e-7b21a649b8cf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:02.286146 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bfe1bcee-8e1a-4b5f-824e-7b21a649b8cf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:02.409994 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bfe1bcee-8e1a-4b5f-824e-7b21a649b8cf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:02.417263 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bfe1bcee-8e1a-4b5f-824e-7b21a649b8cf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1363 microversion: 2.1 time: 0.143814 Jun 24 08:49:02.417866 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 407/788] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:02 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:03.433912 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fe32c5b6-c246-45fa-896c-35f8cdba88f8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:03.434454 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fe32c5b6-c246-45fa-896c-35f8cdba88f8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:03.441492 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fe32c5b6-c246-45fa-896c-35f8cdba88f8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:03.441935 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fe32c5b6-c246-45fa-896c-35f8cdba88f8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:03.442696 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fe32c5b6-c246-45fa-896c-35f8cdba88f8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:03.443124 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fe32c5b6-c246-45fa-896c-35f8cdba88f8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:03.573782 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fe32c5b6-c246-45fa-896c-35f8cdba88f8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:03.581609 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fe32c5b6-c246-45fa-896c-35f8cdba88f8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1363 microversion: 2.1 time: 0.151626 Jun 24 08:49:03.582168 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 382/789] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:03 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:04.598221 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9e920540-4528-476a-90c1-a26fc0fa596e tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:04.598834 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9e920540-4528-476a-90c1-a26fc0fa596e tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:04.604906 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e920540-4528-476a-90c1-a26fc0fa596e tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:04.605354 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e920540-4528-476a-90c1-a26fc0fa596e tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:04.606113 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e920540-4528-476a-90c1-a26fc0fa596e tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:04.606578 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9e920540-4528-476a-90c1-a26fc0fa596e tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:04.730902 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9e920540-4528-476a-90c1-a26fc0fa596e tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:04.738870 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9e920540-4528-476a-90c1-a26fc0fa596e tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1363 microversion: 2.1 time: 0.144998 Jun 24 08:49:04.739470 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 408/790] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:04 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:05.756336 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d94b542a-1e62-4fd7-8028-0f98adce01a2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:05.756895 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d94b542a-1e62-4fd7-8028-0f98adce01a2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:05.763508 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d94b542a-1e62-4fd7-8028-0f98adce01a2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:05.763987 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d94b542a-1e62-4fd7-8028-0f98adce01a2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:05.764752 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d94b542a-1e62-4fd7-8028-0f98adce01a2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:05.765340 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d94b542a-1e62-4fd7-8028-0f98adce01a2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:05.897201 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d94b542a-1e62-4fd7-8028-0f98adce01a2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:05.904423 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d94b542a-1e62-4fd7-8028-0f98adce01a2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1363 microversion: 2.1 time: 0.152045 Jun 24 08:49:05.904981 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 383/791] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:05 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:06.229529 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-f50c5848-5ada-41d3-a9ad-260e34f7d06d req-f8dadfd5-e618-460c-b32b-976d070082c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77cd8982-eb26-429b-ba63-c8f02412f7c3", "name": "network-vif-plugged", "status": "completed", "tag": "ac731d01-8032-4238-b050-e3f4a4ae9998"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:06.238588 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-f50c5848-5ada-41d3-a9ad-260e34f7d06d req-f8dadfd5-e618-460c-b32b-976d070082c7 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:06.239055 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-f50c5848-5ada-41d3-a9ad-260e34f7d06d req-f8dadfd5-e618-460c-b32b-976d070082c7 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:06.251174 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-f50c5848-5ada-41d3-a9ad-260e34f7d06d req-f8dadfd5-e618-460c-b32b-976d070082c7 service nova] Creating event network-vif-plugged:ac731d01-8032-4238-b050-e3f4a4ae9998 for instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 on hv-cinder-84517 Jun 24 08:49:06.256549 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-f50c5848-5ada-41d3-a9ad-260e34f7d06d req-f8dadfd5-e618-460c-b32b-976d070082c7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030791 Jun 24 08:49:06.257302 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 409/792] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:49:06.922201 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6bd6c9af-a8dd-42d8-8d66-08b103b0d68d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:06.923073 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6bd6c9af-a8dd-42d8-8d66-08b103b0d68d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:06.925031 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:06.925691 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:06.932209 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bd6c9af-a8dd-42d8-8d66-08b103b0d68d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:06.932655 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bd6c9af-a8dd-42d8-8d66-08b103b0d68d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:06.933414 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bd6c9af-a8dd-42d8-8d66-08b103b0d68d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:06.933847 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6bd6c9af-a8dd-42d8-8d66-08b103b0d68d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:07.060113 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6bd6c9af-a8dd-42d8-8d66-08b103b0d68d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:07.068008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6bd6c9af-a8dd-42d8-8d66-08b103b0d68d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1363 microversion: 2.1 time: 0.150098 Jun 24 08:49:07.068525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 384/793] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:06 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:08.081721 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=6 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:08.086020 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f55c0136-7702-43da-8995-4716b2c5b8f0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:08.086717 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f55c0136-7702-43da-8995-4716b2c5b8f0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:08.093187 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f55c0136-7702-43da-8995-4716b2c5b8f0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:08.093638 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f55c0136-7702-43da-8995-4716b2c5b8f0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:08.094389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f55c0136-7702-43da-8995-4716b2c5b8f0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:08.094823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f55c0136-7702-43da-8995-4716b2c5b8f0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:08.225578 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f55c0136-7702-43da-8995-4716b2c5b8f0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:08.233064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f55c0136-7702-43da-8995-4716b2c5b8f0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1549 microversion: 2.1 time: 0.152807 Jun 24 08:49:08.233618 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 410/794] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:08 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:08.249442 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-51df58d4-d8a7-43c6-821c-1dc368fbeec9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:08.249928 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-51df58d4-d8a7-43c6-821c-1dc368fbeec9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:08.256245 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51df58d4-d8a7-43c6-821c-1dc368fbeec9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:08.256688 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51df58d4-d8a7-43c6-821c-1dc368fbeec9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:08.257440 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51df58d4-d8a7-43c6-821c-1dc368fbeec9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:08.257871 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-51df58d4-d8a7-43c6-821c-1dc368fbeec9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:08.334995 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-51df58d4-d8a7-43c6-821c-1dc368fbeec9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089281 Jun 24 08:49:08.335666 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 385/795] 10.222.0.43 () {58 vars in 1274 bytes} [Fri Jun 24 08:49:08 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:09.490674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-921af5ff-1c05-49fd-b047-b62586795eb0 req-1c86c63d-353b-4d6b-9c18-c8c2420ed231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77cd8982-eb26-429b-ba63-c8f02412f7c3", "tag": "ac731d01-8032-4238-b050-e3f4a4ae9998"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:09.498918 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-921af5ff-1c05-49fd-b047-b62586795eb0 req-1c86c63d-353b-4d6b-9c18-c8c2420ed231 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:09.499400 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-921af5ff-1c05-49fd-b047-b62586795eb0 req-1c86c63d-353b-4d6b-9c18-c8c2420ed231 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:09.511317 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-921af5ff-1c05-49fd-b047-b62586795eb0 req-1c86c63d-353b-4d6b-9c18-c8c2420ed231 service nova] Creating event network-changed:ac731d01-8032-4238-b050-e3f4a4ae9998 for instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 on hv-cinder-84517 Jun 24 08:49:09.516114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-921af5ff-1c05-49fd-b047-b62586795eb0 req-1c86c63d-353b-4d6b-9c18-c8c2420ed231 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029776 Jun 24 08:49:09.516685 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 411/796] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:33.457063 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:33.457742 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=36 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:33.461698 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c80061e5-476f-4b6f-b464-99dd99aeeb5d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:33.462187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c80061e5-476f-4b6f-b464-99dd99aeeb5d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:33.469086 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c80061e5-476f-4b6f-b464-99dd99aeeb5d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:33.469535 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c80061e5-476f-4b6f-b464-99dd99aeeb5d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:33.470903 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c80061e5-476f-4b6f-b464-99dd99aeeb5d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:33.471375 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c80061e5-476f-4b6f-b464-99dd99aeeb5d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:33.493992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c80061e5-476f-4b6f-b464-99dd99aeeb5d tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73/ips" status: 200 len: 150 microversion: 2.20 time: 0.038428 Jun 24 08:49:33.494543 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 386/797] 10.222.0.43 () {60 vars in 1288 bytes} [Fri Jun 24 08:49:33 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:49:35.256308 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:35.257066 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=28 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:35.261524 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-317eeefb-3f01-4365-8388-4737aa791d7c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:35.262194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-317eeefb-3f01-4365-8388-4737aa791d7c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:35.270537 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-317eeefb-3f01-4365-8388-4737aa791d7c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:35.271010 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-317eeefb-3f01-4365-8388-4737aa791d7c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:35.271820 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-317eeefb-3f01-4365-8388-4737aa791d7c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:35.272278 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-317eeefb-3f01-4365-8388-4737aa791d7c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:35.294930 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-317eeefb-3f01-4365-8388-4737aa791d7c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lazy-loading 'flavor' on Instance uuid 9e8f47c2-c495-4707-8867-99604c4a1e73 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:49:35.550197 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-317eeefb-3f01-4365-8388-4737aa791d7c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "POST /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73/action" status: 202 len: 0 microversion: 2.20 time: 0.294767 Jun 24 08:49:35.550817 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 412/798] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Jun 24 08:49:35 2022] POST /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:49:35.559132 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-48c6c2f4-669c-46e5-8522-0c118e4229d8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:35.559774 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-48c6c2f4-669c-46e5-8522-0c118e4229d8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:35.566316 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48c6c2f4-669c-46e5-8522-0c118e4229d8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:35.566738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48c6c2f4-669c-46e5-8522-0c118e4229d8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:35.567526 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48c6c2f4-669c-46e5-8522-0c118e4229d8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:35.567966 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48c6c2f4-669c-46e5-8522-0c118e4229d8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:35.704166 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-48c6c2f4-669c-46e5-8522-0c118e4229d8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:35.712409 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-48c6c2f4-669c-46e5-8522-0c118e4229d8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:35.713917 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-48c6c2f4-669c-46e5-8522-0c118e4229d8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:35.715058 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-48c6c2f4-669c-46e5-8522-0c118e4229d8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1720 microversion: 2.20 time: 0.159898 Jun 24 08:49:35.715652 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 387/799] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:35 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:36.734657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-46fe6fae-7358-4f46-8f29-fcd783f5fbfa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:36.735380 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-46fe6fae-7358-4f46-8f29-fcd783f5fbfa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:36.742331 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-46fe6fae-7358-4f46-8f29-fcd783f5fbfa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:36.742777 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-46fe6fae-7358-4f46-8f29-fcd783f5fbfa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:36.743574 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-46fe6fae-7358-4f46-8f29-fcd783f5fbfa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:36.744010 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-46fe6fae-7358-4f46-8f29-fcd783f5fbfa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:36.883640 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-46fe6fae-7358-4f46-8f29-fcd783f5fbfa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:36.892029 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-46fe6fae-7358-4f46-8f29-fcd783f5fbfa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:36.893579 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-46fe6fae-7358-4f46-8f29-fcd783f5fbfa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:36.894746 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-46fe6fae-7358-4f46-8f29-fcd783f5fbfa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1720 microversion: 2.20 time: 0.164496 Jun 24 08:49:36.895317 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 413/800] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:36 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:37.913124 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-267d85a1-57eb-4aca-8018-e3103e096e2a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:37.913727 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-267d85a1-57eb-4aca-8018-e3103e096e2a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:37.920113 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-267d85a1-57eb-4aca-8018-e3103e096e2a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:37.920556 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-267d85a1-57eb-4aca-8018-e3103e096e2a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:37.921330 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-267d85a1-57eb-4aca-8018-e3103e096e2a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:37.921763 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-267d85a1-57eb-4aca-8018-e3103e096e2a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:38.053882 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-267d85a1-57eb-4aca-8018-e3103e096e2a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:38.061706 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-267d85a1-57eb-4aca-8018-e3103e096e2a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:38.063292 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-267d85a1-57eb-4aca-8018-e3103e096e2a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:38.065032 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-267d85a1-57eb-4aca-8018-e3103e096e2a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1720 microversion: 2.20 time: 0.155798 Jun 24 08:49:38.065572 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 388/801] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:37 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:39.083906 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e6797235-4836-46f6-81d7-8f1ac62c0922 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:39.084497 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e6797235-4836-46f6-81d7-8f1ac62c0922 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:39.090503 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e6797235-4836-46f6-81d7-8f1ac62c0922 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:39.090951 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e6797235-4836-46f6-81d7-8f1ac62c0922 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:39.091756 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e6797235-4836-46f6-81d7-8f1ac62c0922 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:39.092188 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e6797235-4836-46f6-81d7-8f1ac62c0922 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:39.219674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e6797235-4836-46f6-81d7-8f1ac62c0922 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:39.227479 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e6797235-4836-46f6-81d7-8f1ac62c0922 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:39.228992 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e6797235-4836-46f6-81d7-8f1ac62c0922 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:39.230135 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e6797235-4836-46f6-81d7-8f1ac62c0922 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1720 microversion: 2.20 time: 0.150906 Jun 24 08:49:39.230687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 414/802] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:39 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:40.248307 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4b731e28-8b69-42ba-b83b-f71de4a1d4ca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:40.248908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4b731e28-8b69-42ba-b83b-f71de4a1d4ca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:40.255307 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4b731e28-8b69-42ba-b83b-f71de4a1d4ca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:40.255745 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4b731e28-8b69-42ba-b83b-f71de4a1d4ca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:40.256492 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4b731e28-8b69-42ba-b83b-f71de4a1d4ca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:40.256922 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4b731e28-8b69-42ba-b83b-f71de4a1d4ca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:40.384116 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4b731e28-8b69-42ba-b83b-f71de4a1d4ca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:40.391761 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4b731e28-8b69-42ba-b83b-f71de4a1d4ca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:40.393779 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4b731e28-8b69-42ba-b83b-f71de4a1d4ca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:40.394912 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4b731e28-8b69-42ba-b83b-f71de4a1d4ca tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1720 microversion: 2.20 time: 0.150463 Jun 24 08:49:40.395495 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 389/803] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:40 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:41.412891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b3551f7c-8cb0-4111-bf41-95b68496ee50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:41.413499 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b3551f7c-8cb0-4111-bf41-95b68496ee50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:41.419477 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3551f7c-8cb0-4111-bf41-95b68496ee50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:41.419925 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3551f7c-8cb0-4111-bf41-95b68496ee50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:41.420688 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3551f7c-8cb0-4111-bf41-95b68496ee50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:41.421121 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3551f7c-8cb0-4111-bf41-95b68496ee50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:41.560728 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b3551f7c-8cb0-4111-bf41-95b68496ee50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:41.569066 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b3551f7c-8cb0-4111-bf41-95b68496ee50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:41.570562 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b3551f7c-8cb0-4111-bf41-95b68496ee50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:41.571737 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b3551f7c-8cb0-4111-bf41-95b68496ee50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1720 microversion: 2.20 time: 0.162708 Jun 24 08:49:41.572292 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 415/804] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:41 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:42.589802 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2894fc33-1eb6-4cde-ac14-e0a5f76c96ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:42.590413 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2894fc33-1eb6-4cde-ac14-e0a5f76c96ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:42.597469 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2894fc33-1eb6-4cde-ac14-e0a5f76c96ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:42.597915 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2894fc33-1eb6-4cde-ac14-e0a5f76c96ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:42.598671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2894fc33-1eb6-4cde-ac14-e0a5f76c96ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:42.599105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2894fc33-1eb6-4cde-ac14-e0a5f76c96ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:42.724753 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2894fc33-1eb6-4cde-ac14-e0a5f76c96ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:42.732558 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2894fc33-1eb6-4cde-ac14-e0a5f76c96ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:42.734069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2894fc33-1eb6-4cde-ac14-e0a5f76c96ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:42.735225 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2894fc33-1eb6-4cde-ac14-e0a5f76c96ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1720 microversion: 2.20 time: 0.149357 Jun 24 08:49:42.735786 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 390/805] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:42 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:43.753589 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1b3e3c62-3537-4d66-8770-4c39e53157aa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:43.754757 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1b3e3c62-3537-4d66-8770-4c39e53157aa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:43.761025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b3e3c62-3537-4d66-8770-4c39e53157aa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:43.761475 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b3e3c62-3537-4d66-8770-4c39e53157aa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:43.762245 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b3e3c62-3537-4d66-8770-4c39e53157aa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:43.762678 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b3e3c62-3537-4d66-8770-4c39e53157aa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:43.890611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1b3e3c62-3537-4d66-8770-4c39e53157aa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:43.898999 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1b3e3c62-3537-4d66-8770-4c39e53157aa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:43.900566 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1b3e3c62-3537-4d66-8770-4c39e53157aa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:43.901727 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1b3e3c62-3537-4d66-8770-4c39e53157aa tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1720 microversion: 2.20 time: 0.152173 Jun 24 08:49:43.902281 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 416/806] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:43 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:44.920506 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8239cce5-08bc-4d0b-b414-7a19752bb17e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:44.921238 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8239cce5-08bc-4d0b-b414-7a19752bb17e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:44.928736 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8239cce5-08bc-4d0b-b414-7a19752bb17e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:44.929190 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8239cce5-08bc-4d0b-b414-7a19752bb17e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:44.929954 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8239cce5-08bc-4d0b-b414-7a19752bb17e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:44.930392 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8239cce5-08bc-4d0b-b414-7a19752bb17e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:45.058387 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8239cce5-08bc-4d0b-b414-7a19752bb17e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:45.066173 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8239cce5-08bc-4d0b-b414-7a19752bb17e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:45.067701 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8239cce5-08bc-4d0b-b414-7a19752bb17e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:45.068868 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8239cce5-08bc-4d0b-b414-7a19752bb17e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1720 microversion: 2.20 time: 0.152276 Jun 24 08:49:45.069419 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 391/807] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:44 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:46.087125 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4eb5240d-7ee6-4f57-bc0d-100800a83fa6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:46.087777 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4eb5240d-7ee6-4f57-bc0d-100800a83fa6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:46.093908 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4eb5240d-7ee6-4f57-bc0d-100800a83fa6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:46.094418 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4eb5240d-7ee6-4f57-bc0d-100800a83fa6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:46.095112 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4eb5240d-7ee6-4f57-bc0d-100800a83fa6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:46.095570 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4eb5240d-7ee6-4f57-bc0d-100800a83fa6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:46.223588 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4eb5240d-7ee6-4f57-bc0d-100800a83fa6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:46.231430 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4eb5240d-7ee6-4f57-bc0d-100800a83fa6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:46.232940 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4eb5240d-7ee6-4f57-bc0d-100800a83fa6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:46.234091 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4eb5240d-7ee6-4f57-bc0d-100800a83fa6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1720 microversion: 2.20 time: 0.150916 Jun 24 08:49:46.234658 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 417/808] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:46 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:47.252804 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b44d7d71-23ab-4584-90ec-62e0c6e79976 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:47.253405 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b44d7d71-23ab-4584-90ec-62e0c6e79976 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:47.259816 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b44d7d71-23ab-4584-90ec-62e0c6e79976 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:47.260260 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b44d7d71-23ab-4584-90ec-62e0c6e79976 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:47.261018 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b44d7d71-23ab-4584-90ec-62e0c6e79976 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:47.261445 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b44d7d71-23ab-4584-90ec-62e0c6e79976 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:47.391807 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b44d7d71-23ab-4584-90ec-62e0c6e79976 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:47.400310 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b44d7d71-23ab-4584-90ec-62e0c6e79976 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:47.401837 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b44d7d71-23ab-4584-90ec-62e0c6e79976 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:47.402991 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b44d7d71-23ab-4584-90ec-62e0c6e79976 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1741 microversion: 2.20 time: 0.154065 Jun 24 08:49:47.403580 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 392/809] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:47 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:48.421633 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-97ff15c0-38f2-4299-85f2-a7f9cebcecf1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:48.422238 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-97ff15c0-38f2-4299-85f2-a7f9cebcecf1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:48.428599 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-97ff15c0-38f2-4299-85f2-a7f9cebcecf1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:48.429168 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-97ff15c0-38f2-4299-85f2-a7f9cebcecf1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:48.429802 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-97ff15c0-38f2-4299-85f2-a7f9cebcecf1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:48.430237 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-97ff15c0-38f2-4299-85f2-a7f9cebcecf1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:48.560392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-97ff15c0-38f2-4299-85f2-a7f9cebcecf1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:48.568366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-97ff15c0-38f2-4299-85f2-a7f9cebcecf1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:48.569878 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-97ff15c0-38f2-4299-85f2-a7f9cebcecf1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:48.571030 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-97ff15c0-38f2-4299-85f2-a7f9cebcecf1 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1741 microversion: 2.20 time: 0.153404 Jun 24 08:49:48.571640 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 418/810] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:48 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:49.589935 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-009af514-22af-4c8f-9760-436d460b57df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:49.590538 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-009af514-22af-4c8f-9760-436d460b57df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:49.597449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-009af514-22af-4c8f-9760-436d460b57df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:49.597891 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-009af514-22af-4c8f-9760-436d460b57df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:49.598642 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-009af514-22af-4c8f-9760-436d460b57df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:49.599072 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-009af514-22af-4c8f-9760-436d460b57df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:49.732819 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-009af514-22af-4c8f-9760-436d460b57df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:49.741166 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-009af514-22af-4c8f-9760-436d460b57df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:49.742666 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-009af514-22af-4c8f-9760-436d460b57df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:49.743839 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-009af514-22af-4c8f-9760-436d460b57df tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1741 microversion: 2.20 time: 0.157852 Jun 24 08:49:49.744387 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 393/811] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:49 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:50.432603 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-1b0a8928-e947-476a-a5bd-a41933a87e53 req-77d32431-2455-43ad-91d3-bf0e6fd82f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8f47c2-c495-4707-8867-99604c4a1e73", "name": "network-vif-plugged", "status": "completed", "tag": "ddb01264-6505-4ff1-b632-85b797417418"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:50.441389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-1b0a8928-e947-476a-a5bd-a41933a87e53 req-77d32431-2455-43ad-91d3-bf0e6fd82f00 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:50.441916 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-1b0a8928-e947-476a-a5bd-a41933a87e53 req-77d32431-2455-43ad-91d3-bf0e6fd82f00 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:50.453641 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-1b0a8928-e947-476a-a5bd-a41933a87e53 req-77d32431-2455-43ad-91d3-bf0e6fd82f00 service nova] Creating event network-vif-plugged:ddb01264-6505-4ff1-b632-85b797417418 for instance 9e8f47c2-c495-4707-8867-99604c4a1e73 on hv-cinder-84517 Jun 24 08:49:50.459203 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-1b0a8928-e947-476a-a5bd-a41933a87e53 req-77d32431-2455-43ad-91d3-bf0e6fd82f00 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030323 Jun 24 08:49:50.459806 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 419/812] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:50.761848 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dc59de5e-8e43-431c-81b9-6b50ac73fe13 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:50.762380 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dc59de5e-8e43-431c-81b9-6b50ac73fe13 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:50.768895 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc59de5e-8e43-431c-81b9-6b50ac73fe13 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:50.769339 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc59de5e-8e43-431c-81b9-6b50ac73fe13 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:50.770153 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc59de5e-8e43-431c-81b9-6b50ac73fe13 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:50.770569 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dc59de5e-8e43-431c-81b9-6b50ac73fe13 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:50.895115 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dc59de5e-8e43-431c-81b9-6b50ac73fe13 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:50.903123 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dc59de5e-8e43-431c-81b9-6b50ac73fe13 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:50.904665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dc59de5e-8e43-431c-81b9-6b50ac73fe13 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:50.905846 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dc59de5e-8e43-431c-81b9-6b50ac73fe13 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1741 microversion: 2.20 time: 0.148039 Jun 24 08:49:50.906407 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 394/813] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:50 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1741 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:51.925686 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-535d5cf5-7fab-4dd1-ac94-13b0498e21dd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:51.926382 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-535d5cf5-7fab-4dd1-ac94-13b0498e21dd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:51.932582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-535d5cf5-7fab-4dd1-ac94-13b0498e21dd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:51.933027 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-535d5cf5-7fab-4dd1-ac94-13b0498e21dd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:51.933783 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-535d5cf5-7fab-4dd1-ac94-13b0498e21dd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:51.934215 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-535d5cf5-7fab-4dd1-ac94-13b0498e21dd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:52.062829 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-535d5cf5-7fab-4dd1-ac94-13b0498e21dd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:52.071340 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-535d5cf5-7fab-4dd1-ac94-13b0498e21dd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:52.072832 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-535d5cf5-7fab-4dd1-ac94-13b0498e21dd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:52.073971 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-535d5cf5-7fab-4dd1-ac94-13b0498e21dd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1741 microversion: 2.20 time: 0.153461 Jun 24 08:49:52.074528 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 420/814] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:51 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:53.091850 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-83c36cb0-22ac-4a17-ac09-e56d9dad63cb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:53.092435 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-83c36cb0-22ac-4a17-ac09-e56d9dad63cb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:53.098717 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-83c36cb0-22ac-4a17-ac09-e56d9dad63cb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:53.099168 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-83c36cb0-22ac-4a17-ac09-e56d9dad63cb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:53.099954 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-83c36cb0-22ac-4a17-ac09-e56d9dad63cb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:53.100379 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-83c36cb0-22ac-4a17-ac09-e56d9dad63cb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:53.231172 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-83c36cb0-22ac-4a17-ac09-e56d9dad63cb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:53.239039 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-83c36cb0-22ac-4a17-ac09-e56d9dad63cb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:53.240720 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-83c36cb0-22ac-4a17-ac09-e56d9dad63cb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:53.241902 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-83c36cb0-22ac-4a17-ac09-e56d9dad63cb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1741 microversion: 2.20 time: 0.153960 Jun 24 08:49:53.242681 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 395/815] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:53 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:54.260943 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-deed99b1-0fc9-4a91-adf5-18ec8b9b66e3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:54.261545 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-deed99b1-0fc9-4a91-adf5-18ec8b9b66e3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:54.268319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-deed99b1-0fc9-4a91-adf5-18ec8b9b66e3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:54.268756 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-deed99b1-0fc9-4a91-adf5-18ec8b9b66e3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:54.269522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-deed99b1-0fc9-4a91-adf5-18ec8b9b66e3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:54.269953 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-deed99b1-0fc9-4a91-adf5-18ec8b9b66e3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:54.408323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-deed99b1-0fc9-4a91-adf5-18ec8b9b66e3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:54.418369 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-deed99b1-0fc9-4a91-adf5-18ec8b9b66e3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:54.419905 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-deed99b1-0fc9-4a91-adf5-18ec8b9b66e3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:54.421046 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-deed99b1-0fc9-4a91-adf5-18ec8b9b66e3 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1736 microversion: 2.20 time: 0.164053 Jun 24 08:49:54.421895 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 421/816] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:54 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:55.446597 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9efd7838-d22a-43b0-ac02-0155aabd6727 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:55.447154 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9efd7838-d22a-43b0-ac02-0155aabd6727 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:55.454572 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9efd7838-d22a-43b0-ac02-0155aabd6727 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:55.455047 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9efd7838-d22a-43b0-ac02-0155aabd6727 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:55.455847 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9efd7838-d22a-43b0-ac02-0155aabd6727 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:55.456292 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9efd7838-d22a-43b0-ac02-0155aabd6727 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:55.591596 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9efd7838-d22a-43b0-ac02-0155aabd6727 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:55.600625 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9efd7838-d22a-43b0-ac02-0155aabd6727 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:55.602157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9efd7838-d22a-43b0-ac02-0155aabd6727 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:55.603339 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9efd7838-d22a-43b0-ac02-0155aabd6727 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1736 microversion: 2.20 time: 0.161474 Jun 24 08:49:55.603921 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 396/817] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:55 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:56.623096 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2f6a6e0e-53d3-4534-9b28-ffba9e7456ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:56.623738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2f6a6e0e-53d3-4534-9b28-ffba9e7456ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:56.630881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2f6a6e0e-53d3-4534-9b28-ffba9e7456ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:56.631362 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2f6a6e0e-53d3-4534-9b28-ffba9e7456ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:56.632149 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2f6a6e0e-53d3-4534-9b28-ffba9e7456ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:56.632587 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2f6a6e0e-53d3-4534-9b28-ffba9e7456ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:56.767093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2f6a6e0e-53d3-4534-9b28-ffba9e7456ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:56.776324 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2f6a6e0e-53d3-4534-9b28-ffba9e7456ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:56.777851 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2f6a6e0e-53d3-4534-9b28-ffba9e7456ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:56.779055 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2f6a6e0e-53d3-4534-9b28-ffba9e7456ac tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1736 microversion: 2.20 time: 0.161001 Jun 24 08:49:56.779923 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 422/818] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:56 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:57.800383 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9560ba46-8e0d-45c4-a330-92949ee0db82 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:57.801003 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9560ba46-8e0d-45c4-a330-92949ee0db82 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:57.808220 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9560ba46-8e0d-45c4-a330-92949ee0db82 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:57.808748 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9560ba46-8e0d-45c4-a330-92949ee0db82 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:57.809587 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9560ba46-8e0d-45c4-a330-92949ee0db82 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:57.810089 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9560ba46-8e0d-45c4-a330-92949ee0db82 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:57.951590 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9560ba46-8e0d-45c4-a330-92949ee0db82 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:57.960359 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9560ba46-8e0d-45c4-a330-92949ee0db82 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:57.961864 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9560ba46-8e0d-45c4-a330-92949ee0db82 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:57.963046 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9560ba46-8e0d-45c4-a330-92949ee0db82 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1736 microversion: 2.20 time: 0.167320 Jun 24 08:49:57.963815 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 397/819] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:57 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:58.981949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-626e4501-be06-4193-bfd8-33d352378c44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:58.983273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-626e4501-be06-4193-bfd8-33d352378c44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:58.990086 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-626e4501-be06-4193-bfd8-33d352378c44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:58.990825 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-626e4501-be06-4193-bfd8-33d352378c44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:58.991668 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-626e4501-be06-4193-bfd8-33d352378c44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:58.992107 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-626e4501-be06-4193-bfd8-33d352378c44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:59.125711 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-626e4501-be06-4193-bfd8-33d352378c44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:59.143884 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-626e4501-be06-4193-bfd8-33d352378c44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:59.145567 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-626e4501-be06-4193-bfd8-33d352378c44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:59.146765 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-626e4501-be06-4193-bfd8-33d352378c44 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1736 microversion: 2.20 time: 0.168824 Jun 24 08:49:59.147342 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 423/820] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:58 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:00.166597 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-43b1a16b-177f-41f5-b7cc-15adfaa5dc68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:00.167479 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-43b1a16b-177f-41f5-b7cc-15adfaa5dc68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:00.178975 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-43b1a16b-177f-41f5-b7cc-15adfaa5dc68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:00.178975 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-43b1a16b-177f-41f5-b7cc-15adfaa5dc68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:00.178975 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-43b1a16b-177f-41f5-b7cc-15adfaa5dc68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:00.178975 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-43b1a16b-177f-41f5-b7cc-15adfaa5dc68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:00.331922 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-43b1a16b-177f-41f5-b7cc-15adfaa5dc68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:00.339728 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-43b1a16b-177f-41f5-b7cc-15adfaa5dc68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:00.341362 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-43b1a16b-177f-41f5-b7cc-15adfaa5dc68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:00.342519 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-43b1a16b-177f-41f5-b7cc-15adfaa5dc68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1736 microversion: 2.20 time: 0.180064 Jun 24 08:50:00.343079 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 398/821] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:00 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:00.902242 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7f77936e-f97c-4475-bd2b-b153ce64e60b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:00.903376 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7f77936e-f97c-4475-bd2b-b153ce64e60b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:00.905885 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-10045415-20dd-4fa2-9683-49195dcb1626 req-e9296cda-70b1-4bbe-b981-c89c2a731c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73106291-ded8-47c4-8b9f-6ee2c7fe3926", "tag": "431156a0-7086-4030-a88f-b4d0acbdcfb2"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:00.914669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-10045415-20dd-4fa2-9683-49195dcb1626 req-e9296cda-70b1-4bbe-b981-c89c2a731c6e service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:00.915492 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-10045415-20dd-4fa2-9683-49195dcb1626 req-e9296cda-70b1-4bbe-b981-c89c2a731c6e service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:00.915639 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f77936e-f97c-4475-bd2b-b153ce64e60b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:00.916027 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f77936e-f97c-4475-bd2b-b153ce64e60b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:00.916796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f77936e-f97c-4475-bd2b-b153ce64e60b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:00.917221 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f77936e-f97c-4475-bd2b-b153ce64e60b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:00.937640 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-10045415-20dd-4fa2-9683-49195dcb1626 req-e9296cda-70b1-4bbe-b981-c89c2a731c6e service nova] Creating event network-changed:431156a0-7086-4030-a88f-b4d0acbdcfb2 for instance 73106291-ded8-47c4-8b9f-6ee2c7fe3926 on hv-cinder-84517 Jun 24 08:50:00.949720 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-10045415-20dd-4fa2-9683-49195dcb1626 req-e9296cda-70b1-4bbe-b981-c89c2a731c6e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047936 Jun 24 08:50:00.956167 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 399/822] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:50:00.963639 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7f77936e-f97c-4475-bd2b-b153ce64e60b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:50:01.092798 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7f77936e-f97c-4475-bd2b-b153ce64e60b tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "DELETE /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 204 len: 0 microversion: 2.1 time: 0.192894 Jun 24 08:50:01.096687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 424/823] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:50:00 2022] DELETE /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:50:01.111097 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f9f26e7e-59a3-4016-b185-f7ac8fb84914 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:01.114106 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f9f26e7e-59a3-4016-b185-f7ac8fb84914 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:01.130350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9f26e7e-59a3-4016-b185-f7ac8fb84914 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:01.131749 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9f26e7e-59a3-4016-b185-f7ac8fb84914 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:01.132945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9f26e7e-59a3-4016-b185-f7ac8fb84914 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:01.133449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f9f26e7e-59a3-4016-b185-f7ac8fb84914 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:01.312697 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f9f26e7e-59a3-4016-b185-f7ac8fb84914 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:01.321335 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f9f26e7e-59a3-4016-b185-f7ac8fb84914 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1566 microversion: 2.1 time: 0.221013 Jun 24 08:50:01.321905 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 400/824] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:01 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:01.364043 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-81f41d79-7de8-4b17-9ac4-8c1027e89cdc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:01.365173 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-81f41d79-7de8-4b17-9ac4-8c1027e89cdc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:01.371565 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81f41d79-7de8-4b17-9ac4-8c1027e89cdc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:01.372355 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81f41d79-7de8-4b17-9ac4-8c1027e89cdc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:01.373398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81f41d79-7de8-4b17-9ac4-8c1027e89cdc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:01.374183 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-81f41d79-7de8-4b17-9ac4-8c1027e89cdc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:01.399536 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:01.530475 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-81f41d79-7de8-4b17-9ac4-8c1027e89cdc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:01.544993 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-81f41d79-7de8-4b17-9ac4-8c1027e89cdc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:01.546709 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-81f41d79-7de8-4b17-9ac4-8c1027e89cdc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:01.550257 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-81f41d79-7de8-4b17-9ac4-8c1027e89cdc tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1736 microversion: 2.20 time: 0.189795 Jun 24 08:50:01.550257 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 425/825] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:01 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:02.339441 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-54b88879-0277-46c1-87b2-7ce375ba21f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:02.340760 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-54b88879-0277-46c1-87b2-7ce375ba21f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:02.348387 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54b88879-0277-46c1-87b2-7ce375ba21f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:02.348932 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54b88879-0277-46c1-87b2-7ce375ba21f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:02.349766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54b88879-0277-46c1-87b2-7ce375ba21f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:02.350293 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54b88879-0277-46c1-87b2-7ce375ba21f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:02.510016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-54b88879-0277-46c1-87b2-7ce375ba21f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:02.519732 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-54b88879-0277-46c1-87b2-7ce375ba21f0 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1566 microversion: 2.1 time: 0.183941 Jun 24 08:50:02.520690 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 401/826] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:02 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:02.569295 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-90dc6a1a-568a-4a59-826e-6e21f0a74edd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:02.569947 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-90dc6a1a-568a-4a59-826e-6e21f0a74edd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:02.576918 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-90dc6a1a-568a-4a59-826e-6e21f0a74edd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:02.577413 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-90dc6a1a-568a-4a59-826e-6e21f0a74edd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:02.578210 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-90dc6a1a-568a-4a59-826e-6e21f0a74edd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:02.578655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-90dc6a1a-568a-4a59-826e-6e21f0a74edd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:02.725012 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-90dc6a1a-568a-4a59-826e-6e21f0a74edd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:02.742451 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-90dc6a1a-568a-4a59-826e-6e21f0a74edd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:02.753575 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-90dc6a1a-568a-4a59-826e-6e21f0a74edd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:02.760446 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-90dc6a1a-568a-4a59-826e-6e21f0a74edd tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1736 microversion: 2.20 time: 0.189879 Jun 24 08:50:02.762406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 426/827] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:02 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:03.536987 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-16e2360d-8a2f-47b5-8d5a-ba77f0ed2e56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:03.537699 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-16e2360d-8a2f-47b5-8d5a-ba77f0ed2e56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:03.541896 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=33 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:03.546299 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16e2360d-8a2f-47b5-8d5a-ba77f0ed2e56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:03.546815 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16e2360d-8a2f-47b5-8d5a-ba77f0ed2e56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:03.547687 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16e2360d-8a2f-47b5-8d5a-ba77f0ed2e56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:03.548188 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16e2360d-8a2f-47b5-8d5a-ba77f0ed2e56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:03.554245 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=91 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:03.615879 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-16e2360d-8a2f-47b5-8d5a-ba77f0ed2e56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:03.623940 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-16e2360d-8a2f-47b5-8d5a-ba77f0ed2e56 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1381 microversion: 2.1 time: 0.091201 Jun 24 08:50:03.624891 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 402/828] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:03 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1381 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:03.668587 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-b5e07225-2cc9-4a34-a5aa-5466aaaf34ff req-53549f88-9128-4f08-b945-392731bfaaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73106291-ded8-47c4-8b9f-6ee2c7fe3926", "name": "network-vif-deleted", "tag": "431156a0-7086-4030-a88f-b4d0acbdcfb2"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:03.677916 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-b5e07225-2cc9-4a34-a5aa-5466aaaf34ff req-53549f88-9128-4f08-b945-392731bfaaf3 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:03.678352 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-b5e07225-2cc9-4a34-a5aa-5466aaaf34ff req-53549f88-9128-4f08-b945-392731bfaaf3 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:03.690506 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-b5e07225-2cc9-4a34-a5aa-5466aaaf34ff req-53549f88-9128-4f08-b945-392731bfaaf3 service nova] Creating event network-vif-deleted:431156a0-7086-4030-a88f-b4d0acbdcfb2 for instance 73106291-ded8-47c4-8b9f-6ee2c7fe3926 on hv-cinder-84517 Jun 24 08:50:03.695555 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-b5e07225-2cc9-4a34-a5aa-5466aaaf34ff req-53549f88-9128-4f08-b945-392731bfaaf3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030547 Jun 24 08:50:03.696250 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 427/829] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:03.781629 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-81753389-5ec2-4e23-98ec-3ce3aae656d6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:03.782294 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-81753389-5ec2-4e23-98ec-3ce3aae656d6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:03.789409 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81753389-5ec2-4e23-98ec-3ce3aae656d6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:03.789857 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81753389-5ec2-4e23-98ec-3ce3aae656d6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:03.790611 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81753389-5ec2-4e23-98ec-3ce3aae656d6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:03.791043 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81753389-5ec2-4e23-98ec-3ce3aae656d6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:03.916484 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-81753389-5ec2-4e23-98ec-3ce3aae656d6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:03.924892 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-81753389-5ec2-4e23-98ec-3ce3aae656d6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:03.926453 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-81753389-5ec2-4e23-98ec-3ce3aae656d6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:03.927699 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-81753389-5ec2-4e23-98ec-3ce3aae656d6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1736 microversion: 2.20 time: 0.150232 Jun 24 08:50:03.928253 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 403/830] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:03 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:04.642181 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0c35bb50-91a1-408f-8ca8-b19d35e3d89d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:04.643667 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0c35bb50-91a1-408f-8ca8-b19d35e3d89d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:04.651299 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0c35bb50-91a1-408f-8ca8-b19d35e3d89d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:04.651745 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0c35bb50-91a1-408f-8ca8-b19d35e3d89d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:04.652786 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0c35bb50-91a1-408f-8ca8-b19d35e3d89d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:04.653216 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0c35bb50-91a1-408f-8ca8-b19d35e3d89d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:04.683847 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0c35bb50-91a1-408f-8ca8-b19d35e3d89d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:04.684327 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0c35bb50-91a1-408f-8ca8-b19d35e3d89d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:04.684740 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-0c35bb50-91a1-408f-8ca8-b19d35e3d89d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lazy-loading 'fault' on Instance uuid 73106291-ded8-47c4-8b9f-6ee2c7fe3926 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:50:04.726340 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0c35bb50-91a1-408f-8ca8-b19d35e3d89d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb223c95f794ebd8d34f3a8627dfd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd567a9e7ba344ca4ac65b276b57995d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:04.734180 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0c35bb50-91a1-408f-8ca8-b19d35e3d89d tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 200 len: 1224 microversion: 2.1 time: 0.097022 Jun 24 08:50:04.734756 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 428/831] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:04 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:04.947269 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6712a9aa-59dc-4fd4-b7b9-5d2f458c73ad tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:04.948026 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6712a9aa-59dc-4fd4-b7b9-5d2f458c73ad tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:04.954603 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6712a9aa-59dc-4fd4-b7b9-5d2f458c73ad tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:04.955681 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6712a9aa-59dc-4fd4-b7b9-5d2f458c73ad tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:04.956451 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6712a9aa-59dc-4fd4-b7b9-5d2f458c73ad tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:04.956883 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6712a9aa-59dc-4fd4-b7b9-5d2f458c73ad tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:05.093239 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6712a9aa-59dc-4fd4-b7b9-5d2f458c73ad tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:05.101569 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6712a9aa-59dc-4fd4-b7b9-5d2f458c73ad tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:05.103072 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6712a9aa-59dc-4fd4-b7b9-5d2f458c73ad tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:05.104241 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6712a9aa-59dc-4fd4-b7b9-5d2f458c73ad tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1718 microversion: 2.20 time: 0.161011 Jun 24 08:50:05.104793 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 404/832] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:04 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:05.751135 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-dc9e28d8-e18c-4399-9567-de67ca5b3999 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:05.752291 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-dc9e28d8-e18c-4399-9567-de67ca5b3999 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] [instance: 73106291-ded8-47c4-8b9f-6ee2c7fe3926] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:05.754194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:05.759530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dc9e28d8-e18c-4399-9567-de67ca5b3999 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:05.759976 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dc9e28d8-e18c-4399-9567-de67ca5b3999 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:05.760728 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dc9e28d8-e18c-4399-9567-de67ca5b3999 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:05.761152 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dc9e28d8-e18c-4399-9567-de67ca5b3999 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:05.775473 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-dc9e28d8-e18c-4399-9567-de67ca5b3999 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] HTTP exception thrown: Instance 73106291-ded8-47c4-8b9f-6ee2c7fe3926 could not be found. Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-dc9e28d8-e18c-4399-9567-de67ca5b3999 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Request method failure captured: Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 HTTP/1.1 Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXlDWCf4JZVrDyraNEDX07LwJXUK-7WFLDX9hPJHleDqCXlNHcmrdZwmpFgVcI4Fyw-_EfAfDfYV5WXzMqMrJY01OC6uy6eudR72BZdIvA0t3z4yvfoKxiWWFyY5bOS9cqav-jNzk_ltZlSQGno4yizqiIzUdA47wcw6P24GyziaL08 Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: d567a9e7ba344ca4ac65b276b57995d1 Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-TestShelveInstance-1297906204 Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:50:05.777064 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:50:05.778674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d567a9e7ba344ca4ac65b276b57995d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d567a9e7ba344ca4ac65b276b57995d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d567a9e7ba344ca4ac65b276b57995d1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d567a9e7ba344ca4ac65b276b57995d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:50:05.778674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-TestShelveInstance-1297906204 Jun 24 08:50:05.778674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: d567a9e7ba344ca4ac65b276b57995d1 Jun 24 08:50:05.778674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-TestShelveInstance-1297906204 Jun 24 08:50:05.778674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-TestShelveInstance-1297906204-project Jun 24 08:50:05.778674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:50:05.778674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:50:05.778674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 7eb223c95f794ebd8d34f3a8627dfd89 Jun 24 08:50:05.778674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-TestShelveInstance-1297906204-project Jun 24 08:50:05.778674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:50:05.778674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 73106291-ded8-47c4-8b9f-6ee2c7fe3926 could not be found. Jun 24 08:50:05.778674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '73106291-ded8-47c4-8b9f-6ee2c7fe3926'} Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73106291-ded8-47c4-8b9f-6ee2c7fe3926 could not be found. Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:50:05.779627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73106291-ded8-47c4-8b9f-6ee2c7fe3926 could not be found. Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73106291-ded8-47c4-8b9f-6ee2c7fe3926 could not be found. Jun 24 08:50:05.780983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:50:05.782225 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-dc9e28d8-e18c-4399-9567-de67ca5b3999 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Returning 404 to user: Instance 73106291-ded8-47c4-8b9f-6ee2c7fe3926 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:50:05.782225 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-dc9e28d8-e18c-4399-9567-de67ca5b3999 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926" status: 404 len: 111 microversion: 2.1 time: 0.031132 Jun 24 08:50:05.782225 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 429/833] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:05 2022] GET /compute/v2.1/servers/73106291-ded8-47c4-8b9f-6ee2c7fe3926 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:50:05.937234 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-490927fe-499a-4d09-b8cc-34c8fbb89283 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] Calling method '.version_select at 0x7fb75c77d310>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:05.957835 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-490927fe-499a-4d09-b8cc-34c8fbb89283 tempest-TestShelveInstance-1297906204 tempest-TestShelveInstance-1297906204-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1763929295" status: 202 len: 0 microversion: 2.1 time: 0.024744 Jun 24 08:50:05.961642 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 405/834] 10.222.0.43 () {58 vars in 1253 bytes} [Fri Jun 24 08:50:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1763929295 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:50:06.124008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-80cb5274-c520-4017-8e49-a84b5d7566ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:06.124753 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-80cb5274-c520-4017-8e49-a84b5d7566ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:06.131282 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-80cb5274-c520-4017-8e49-a84b5d7566ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:06.131873 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-80cb5274-c520-4017-8e49-a84b5d7566ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:06.132633 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-80cb5274-c520-4017-8e49-a84b5d7566ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:06.133059 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-80cb5274-c520-4017-8e49-a84b5d7566ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:06.267595 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-80cb5274-c520-4017-8e49-a84b5d7566ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:06.275734 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-80cb5274-c520-4017-8e49-a84b5d7566ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:06.277334 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-80cb5274-c520-4017-8e49-a84b5d7566ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:06.278568 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-80cb5274-c520-4017-8e49-a84b5d7566ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1718 microversion: 2.20 time: 0.158528 Jun 24 08:50:06.279228 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 430/835] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:06 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:06.533596 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-9c6e0a2d-b183-444e-bd8d-6470d21307d6 req-e4a0a81f-876f-4a9c-8280-fa1bd28ccd80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8f47c2-c495-4707-8867-99604c4a1e73", "name": "network-vif-unplugged", "status": "completed", "tag": "ddb01264-6505-4ff1-b632-85b797417418"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:06.544707 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-9c6e0a2d-b183-444e-bd8d-6470d21307d6 req-e4a0a81f-876f-4a9c-8280-fa1bd28ccd80 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:06.545845 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-9c6e0a2d-b183-444e-bd8d-6470d21307d6 req-e4a0a81f-876f-4a9c-8280-fa1bd28ccd80 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:06.560595 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-9c6e0a2d-b183-444e-bd8d-6470d21307d6 req-e4a0a81f-876f-4a9c-8280-fa1bd28ccd80 service nova] Creating event network-vif-unplugged:ddb01264-6505-4ff1-b632-85b797417418 for instance 9e8f47c2-c495-4707-8867-99604c4a1e73 on hv-cinder-84517 Jun 24 08:50:06.566737 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-9c6e0a2d-b183-444e-bd8d-6470d21307d6 req-e4a0a81f-876f-4a9c-8280-fa1bd28ccd80 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036828 Jun 24 08:50:06.567627 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 406/836] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:07.296970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a60d90c9-d0fb-4de7-8f1d-ae8d232a2e17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:07.297556 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a60d90c9-d0fb-4de7-8f1d-ae8d232a2e17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:07.304536 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a60d90c9-d0fb-4de7-8f1d-ae8d232a2e17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:07.304978 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a60d90c9-d0fb-4de7-8f1d-ae8d232a2e17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:07.305745 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a60d90c9-d0fb-4de7-8f1d-ae8d232a2e17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:07.306175 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a60d90c9-d0fb-4de7-8f1d-ae8d232a2e17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:07.442180 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a60d90c9-d0fb-4de7-8f1d-ae8d232a2e17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:07.451396 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a60d90c9-d0fb-4de7-8f1d-ae8d232a2e17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:07.453191 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a60d90c9-d0fb-4de7-8f1d-ae8d232a2e17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:07.454605 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a60d90c9-d0fb-4de7-8f1d-ae8d232a2e17 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1721 microversion: 2.20 time: 0.161556 Jun 24 08:50:07.455985 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 431/837] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:07 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:07.475783 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-763a2c23-e502-4112-ad71-fa01033350b8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddc1f99d-deb2-4d71-b1ba-d5592eb9b8fd"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:07.476914 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-763a2c23-e502-4112-ad71-fa01033350b8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:07.483650 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-763a2c23-e502-4112-ad71-fa01033350b8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:07.484106 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-763a2c23-e502-4112-ad71-fa01033350b8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:07.485128 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-763a2c23-e502-4112-ad71-fa01033350b8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:07.485737 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-763a2c23-e502-4112-ad71-fa01033350b8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:07.797111 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-763a2c23-e502-4112-ad71-fa01033350b8 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "POST /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.326547 Jun 24 08:50:07.797721 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 407/838] 10.222.0.43 () {62 vars in 1363 bytes} [Fri Jun 24 08:50:07 2022] POST /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73/os-volume_attachments => generated 188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:50:07.932385 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-23e96542-9ec6-4217-9fc7-2b63e4d10cf7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:07.932885 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-23e96542-9ec6-4217-9fc7-2b63e4d10cf7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:07.939077 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23e96542-9ec6-4217-9fc7-2b63e4d10cf7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:07.940094 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23e96542-9ec6-4217-9fc7-2b63e4d10cf7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:07.940913 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23e96542-9ec6-4217-9fc7-2b63e4d10cf7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:07.941348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-23e96542-9ec6-4217-9fc7-2b63e4d10cf7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:08.203476 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-23e96542-9ec6-4217-9fc7-2b63e4d10cf7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73/os-volume_attachments/ddc1f99d-deb2-4d71-b1ba-d5592eb9b8fd" status: 202 len: 0 microversion: 2.20 time: 0.274798 Jun 24 08:50:08.204350 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 432/839] 10.222.0.43 () {60 vars in 1456 bytes} [Fri Jun 24 08:50:07 2022] DELETE /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73/os-volume_attachments/ddc1f99d-deb2-4d71-b1ba-d5592eb9b8fd => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:50:08.270049 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-174f3308-67fa-40b7-b404-d6ea3222bd0b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:08.270656 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-174f3308-67fa-40b7-b404-d6ea3222bd0b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:08.277320 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-174f3308-67fa-40b7-b404-d6ea3222bd0b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:08.277775 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-174f3308-67fa-40b7-b404-d6ea3222bd0b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:08.278586 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-174f3308-67fa-40b7-b404-d6ea3222bd0b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:08.279255 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-174f3308-67fa-40b7-b404-d6ea3222bd0b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:08.360670 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-174f3308-67fa-40b7-b404-d6ea3222bd0b tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "POST /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73/action" status: 202 len: 0 microversion: 2.20 time: 0.094977 Jun 24 08:50:08.361425 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 408/840] 10.222.0.43 () {62 vars in 1318 bytes} [Fri Jun 24 08:50:08 2022] POST /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:50:08.369562 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e5b85a8e-d826-47c8-8ce1-cb3cc770b55c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:08.370266 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e5b85a8e-d826-47c8-8ce1-cb3cc770b55c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:08.377083 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e5b85a8e-d826-47c8-8ce1-cb3cc770b55c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:08.377684 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e5b85a8e-d826-47c8-8ce1-cb3cc770b55c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:08.378532 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e5b85a8e-d826-47c8-8ce1-cb3cc770b55c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:08.379179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e5b85a8e-d826-47c8-8ce1-cb3cc770b55c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:08.540198 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e5b85a8e-d826-47c8-8ce1-cb3cc770b55c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:08.549160 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e5b85a8e-d826-47c8-8ce1-cb3cc770b55c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:08.550777 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e5b85a8e-d826-47c8-8ce1-cb3cc770b55c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:08.552074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e5b85a8e-d826-47c8-8ce1-cb3cc770b55c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1669 microversion: 2.20 time: 0.186540 Jun 24 08:50:08.552868 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 433/841] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:08 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1669 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:09.571608 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e388fbc1-daf7-4702-89e2-edadba2669fe tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:09.572226 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e388fbc1-daf7-4702-89e2-edadba2669fe tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:09.578215 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e388fbc1-daf7-4702-89e2-edadba2669fe tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:09.578953 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e388fbc1-daf7-4702-89e2-edadba2669fe tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:09.579779 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e388fbc1-daf7-4702-89e2-edadba2669fe tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:09.580224 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e388fbc1-daf7-4702-89e2-edadba2669fe tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:10.090797 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e388fbc1-daf7-4702-89e2-edadba2669fe tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:10.099901 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e388fbc1-daf7-4702-89e2-edadba2669fe tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:10.101406 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e388fbc1-daf7-4702-89e2-edadba2669fe tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:10.102558 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e388fbc1-daf7-4702-89e2-edadba2669fe tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1671 microversion: 2.20 time: 0.535390 Jun 24 08:50:10.103107 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 409/842] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:09 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1671 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:11.121561 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-05940c55-ab3a-46af-a259-064faca9d31e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:11.122145 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-05940c55-ab3a-46af-a259-064faca9d31e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:11.131366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-05940c55-ab3a-46af-a259-064faca9d31e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:11.131814 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-05940c55-ab3a-46af-a259-064faca9d31e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:11.132588 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-05940c55-ab3a-46af-a259-064faca9d31e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:11.133018 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-05940c55-ab3a-46af-a259-064faca9d31e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:11.480682 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-05940c55-ab3a-46af-a259-064faca9d31e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:11.500305 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-05940c55-ab3a-46af-a259-064faca9d31e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:11.505209 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-05940c55-ab3a-46af-a259-064faca9d31e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:11.511715 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-05940c55-ab3a-46af-a259-064faca9d31e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.393877 Jun 24 08:50:11.512588 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 434/843] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:11 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:12.532407 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-11c287c5-e275-45c8-992c-ab2f3abeac8f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:12.533074 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-11c287c5-e275-45c8-992c-ab2f3abeac8f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:12.548414 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11c287c5-e275-45c8-992c-ab2f3abeac8f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:12.549417 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11c287c5-e275-45c8-992c-ab2f3abeac8f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:12.552015 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11c287c5-e275-45c8-992c-ab2f3abeac8f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:12.552702 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-11c287c5-e275-45c8-992c-ab2f3abeac8f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:12.941008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-11c287c5-e275-45c8-992c-ab2f3abeac8f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:12.951317 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-11c287c5-e275-45c8-992c-ab2f3abeac8f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:12.957299 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-11c287c5-e275-45c8-992c-ab2f3abeac8f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:12.960618 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-11c287c5-e275-45c8-992c-ab2f3abeac8f tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.433696 Jun 24 08:50:12.962531 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 410/844] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:12 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:13.990596 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-081cc1b5-bdae-405a-900a-6e5a916117d7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:13.991782 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-081cc1b5-bdae-405a-900a-6e5a916117d7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:13.998281 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-081cc1b5-bdae-405a-900a-6e5a916117d7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:13.998986 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-081cc1b5-bdae-405a-900a-6e5a916117d7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:14.002598 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-081cc1b5-bdae-405a-900a-6e5a916117d7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:14.003252 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-081cc1b5-bdae-405a-900a-6e5a916117d7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:14.157607 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-081cc1b5-bdae-405a-900a-6e5a916117d7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:14.171428 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-081cc1b5-bdae-405a-900a-6e5a916117d7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:14.172930 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-081cc1b5-bdae-405a-900a-6e5a916117d7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:14.174384 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-081cc1b5-bdae-405a-900a-6e5a916117d7 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.189605 Jun 24 08:50:14.184457 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 435/845] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:13 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:15.202326 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-040010bb-cbb2-4d66-aa55-c1002a33ad22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:15.203030 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-040010bb-cbb2-4d66-aa55-c1002a33ad22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:15.210328 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-040010bb-cbb2-4d66-aa55-c1002a33ad22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:15.210972 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-040010bb-cbb2-4d66-aa55-c1002a33ad22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:15.211943 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-040010bb-cbb2-4d66-aa55-c1002a33ad22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:15.212378 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-040010bb-cbb2-4d66-aa55-c1002a33ad22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:15.350682 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-040010bb-cbb2-4d66-aa55-c1002a33ad22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:15.358554 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-040010bb-cbb2-4d66-aa55-c1002a33ad22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:15.360093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-040010bb-cbb2-4d66-aa55-c1002a33ad22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:15.361289 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-040010bb-cbb2-4d66-aa55-c1002a33ad22 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.162817 Jun 24 08:50:15.361847 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 411/846] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:15 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:16.380197 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ac206c89-1261-4a15-b503-af432a3c3b68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:16.380805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ac206c89-1261-4a15-b503-af432a3c3b68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:16.387029 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ac206c89-1261-4a15-b503-af432a3c3b68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:16.387595 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ac206c89-1261-4a15-b503-af432a3c3b68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:16.388616 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ac206c89-1261-4a15-b503-af432a3c3b68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:16.389264 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ac206c89-1261-4a15-b503-af432a3c3b68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:16.529074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ac206c89-1261-4a15-b503-af432a3c3b68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:16.537036 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ac206c89-1261-4a15-b503-af432a3c3b68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:16.538544 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ac206c89-1261-4a15-b503-af432a3c3b68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:16.539717 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ac206c89-1261-4a15-b503-af432a3c3b68 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.163956 Jun 24 08:50:16.540273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 436/847] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:16 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:17.557800 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-48c5a726-2d5e-487c-ae42-cdf302afef50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:17.559324 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-48c5a726-2d5e-487c-ae42-cdf302afef50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:17.566675 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48c5a726-2d5e-487c-ae42-cdf302afef50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:17.567120 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48c5a726-2d5e-487c-ae42-cdf302afef50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:17.567918 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48c5a726-2d5e-487c-ae42-cdf302afef50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:17.568349 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-48c5a726-2d5e-487c-ae42-cdf302afef50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:17.705273 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-48c5a726-2d5e-487c-ae42-cdf302afef50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:17.713500 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-48c5a726-2d5e-487c-ae42-cdf302afef50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:17.715011 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-48c5a726-2d5e-487c-ae42-cdf302afef50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:17.716203 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-48c5a726-2d5e-487c-ae42-cdf302afef50 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.162282 Jun 24 08:50:17.716764 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 412/848] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:17 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:18.735672 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b3f16cae-d7ad-498c-85b1-eccdb5b5f4da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:18.740070 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b3f16cae-d7ad-498c-85b1-eccdb5b5f4da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:18.745048 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3f16cae-d7ad-498c-85b1-eccdb5b5f4da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:18.745515 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3f16cae-d7ad-498c-85b1-eccdb5b5f4da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:18.746366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3f16cae-d7ad-498c-85b1-eccdb5b5f4da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:18.746881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b3f16cae-d7ad-498c-85b1-eccdb5b5f4da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:18.903067 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b3f16cae-d7ad-498c-85b1-eccdb5b5f4da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:18.912486 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b3f16cae-d7ad-498c-85b1-eccdb5b5f4da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:18.914012 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b3f16cae-d7ad-498c-85b1-eccdb5b5f4da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:18.915171 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b3f16cae-d7ad-498c-85b1-eccdb5b5f4da tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.183596 Jun 24 08:50:18.915986 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 437/849] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:18 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:19.934074 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2c126c9e-7b69-40c6-b150-4d7bb599dad9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:19.934681 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2c126c9e-7b69-40c6-b150-4d7bb599dad9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:19.941624 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c126c9e-7b69-40c6-b150-4d7bb599dad9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:19.942064 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c126c9e-7b69-40c6-b150-4d7bb599dad9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:19.942828 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c126c9e-7b69-40c6-b150-4d7bb599dad9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:19.943281 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c126c9e-7b69-40c6-b150-4d7bb599dad9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:20.068688 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2c126c9e-7b69-40c6-b150-4d7bb599dad9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:20.076461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2c126c9e-7b69-40c6-b150-4d7bb599dad9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:20.077959 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2c126c9e-7b69-40c6-b150-4d7bb599dad9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:20.079093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2c126c9e-7b69-40c6-b150-4d7bb599dad9 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.148970 Jun 24 08:50:20.080341 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 413/850] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:19 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:21.098597 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-566abfde-4ff2-40dc-b4b4-4c12fe075d47 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:21.099252 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-566abfde-4ff2-40dc-b4b4-4c12fe075d47 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:21.105239 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-566abfde-4ff2-40dc-b4b4-4c12fe075d47 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:21.105684 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-566abfde-4ff2-40dc-b4b4-4c12fe075d47 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:21.106437 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-566abfde-4ff2-40dc-b4b4-4c12fe075d47 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:21.106869 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-566abfde-4ff2-40dc-b4b4-4c12fe075d47 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:21.236066 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-566abfde-4ff2-40dc-b4b4-4c12fe075d47 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:21.244129 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-566abfde-4ff2-40dc-b4b4-4c12fe075d47 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:21.245621 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-566abfde-4ff2-40dc-b4b4-4c12fe075d47 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:21.246762 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-566abfde-4ff2-40dc-b4b4-4c12fe075d47 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.152787 Jun 24 08:50:21.247345 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 438/851] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:21 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:22.264859 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-873e389a-2a52-4862-a548-ee38afaa3291 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:22.265469 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-873e389a-2a52-4862-a548-ee38afaa3291 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:22.272076 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-873e389a-2a52-4862-a548-ee38afaa3291 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:22.272525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-873e389a-2a52-4862-a548-ee38afaa3291 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:22.273282 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-873e389a-2a52-4862-a548-ee38afaa3291 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:22.273721 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-873e389a-2a52-4862-a548-ee38afaa3291 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:22.398921 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-873e389a-2a52-4862-a548-ee38afaa3291 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:22.406659 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-873e389a-2a52-4862-a548-ee38afaa3291 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:22.408670 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-873e389a-2a52-4862-a548-ee38afaa3291 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:22.409799 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-873e389a-2a52-4862-a548-ee38afaa3291 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.148820 Jun 24 08:50:22.410360 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 414/852] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:22 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:23.428416 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-da3298e6-1492-48e3-ab4b-99fa6ee3bf16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:23.429026 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-da3298e6-1492-48e3-ab4b-99fa6ee3bf16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:23.435052 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-da3298e6-1492-48e3-ab4b-99fa6ee3bf16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:23.435477 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-da3298e6-1492-48e3-ab4b-99fa6ee3bf16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:23.436235 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-da3298e6-1492-48e3-ab4b-99fa6ee3bf16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:23.436678 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-da3298e6-1492-48e3-ab4b-99fa6ee3bf16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:23.569530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-da3298e6-1492-48e3-ab4b-99fa6ee3bf16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:23.577447 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-da3298e6-1492-48e3-ab4b-99fa6ee3bf16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:23.578959 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-da3298e6-1492-48e3-ab4b-99fa6ee3bf16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:23.580662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-da3298e6-1492-48e3-ab4b-99fa6ee3bf16 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.156248 Jun 24 08:50:23.581219 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 439/853] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:23 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:24.598575 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5159d8ee-f681-4c2f-ac12-df1369e7dcff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:24.599177 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5159d8ee-f681-4c2f-ac12-df1369e7dcff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:24.605551 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5159d8ee-f681-4c2f-ac12-df1369e7dcff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:24.605996 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5159d8ee-f681-4c2f-ac12-df1369e7dcff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:24.606744 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5159d8ee-f681-4c2f-ac12-df1369e7dcff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:24.607172 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5159d8ee-f681-4c2f-ac12-df1369e7dcff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:24.734252 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5159d8ee-f681-4c2f-ac12-df1369e7dcff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:24.742616 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5159d8ee-f681-4c2f-ac12-df1369e7dcff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:24.744142 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5159d8ee-f681-4c2f-ac12-df1369e7dcff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:24.745275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5159d8ee-f681-4c2f-ac12-df1369e7dcff tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.151147 Jun 24 08:50:24.745825 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 415/854] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:24 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:24.753950 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-00b1ad5d-a6ad-45bc-affc-102aee84dfa9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:24.754439 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-00b1ad5d-a6ad-45bc-affc-102aee84dfa9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:24.760432 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00b1ad5d-a6ad-45bc-affc-102aee84dfa9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:24.760872 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00b1ad5d-a6ad-45bc-affc-102aee84dfa9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:24.761633 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00b1ad5d-a6ad-45bc-affc-102aee84dfa9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:24.762063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00b1ad5d-a6ad-45bc-affc-102aee84dfa9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:24.788697 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-00b1ad5d-a6ad-45bc-affc-102aee84dfa9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/ips" status: 200 len: 145 microversion: 2.1 time: 0.038557 Jun 24 08:50:24.789275 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 440/855] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Jun 24 08:50:24 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:25.763847 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-46a6b6b1-53b4-4a0d-905d-e6af846c574e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:25.764437 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-46a6b6b1-53b4-4a0d-905d-e6af846c574e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:25.771165 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-46a6b6b1-53b4-4a0d-905d-e6af846c574e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:25.771639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-46a6b6b1-53b4-4a0d-905d-e6af846c574e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:25.772403 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-46a6b6b1-53b4-4a0d-905d-e6af846c574e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:25.772835 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-46a6b6b1-53b4-4a0d-905d-e6af846c574e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:25.903404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-46a6b6b1-53b4-4a0d-905d-e6af846c574e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:25.905646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:25.913825 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-46a6b6b1-53b4-4a0d-905d-e6af846c574e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:25.915363 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-46a6b6b1-53b4-4a0d-905d-e6af846c574e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:25.916499 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-46a6b6b1-53b4-4a0d-905d-e6af846c574e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.156600 Jun 24 08:50:25.917052 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 416/856] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:25 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:26.935732 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-494f59f5-ee8b-41b7-bf13-12addc860a64 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:26.936346 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-494f59f5-ee8b-41b7-bf13-12addc860a64 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:26.942847 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-494f59f5-ee8b-41b7-bf13-12addc860a64 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:26.943327 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-494f59f5-ee8b-41b7-bf13-12addc860a64 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:26.944087 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-494f59f5-ee8b-41b7-bf13-12addc860a64 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:26.944523 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-494f59f5-ee8b-41b7-bf13-12addc860a64 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:26.948439 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:27.078101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-494f59f5-ee8b-41b7-bf13-12addc860a64 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:27.086118 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-494f59f5-ee8b-41b7-bf13-12addc860a64 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:27.087648 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-494f59f5-ee8b-41b7-bf13-12addc860a64 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:27.088782 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-494f59f5-ee8b-41b7-bf13-12addc860a64 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.157027 Jun 24 08:50:27.089333 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 441/857] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:26 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:27.556524 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4868177a-303e-4079-a1c7-7c62e3960074 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "735c6ca9-2710-48aa-a089-522e3d0ef0bb"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:27.557660 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4868177a-303e-4079-a1c7-7c62e3960074 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:27.564958 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4868177a-303e-4079-a1c7-7c62e3960074 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:27.565404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4868177a-303e-4079-a1c7-7c62e3960074 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:27.566157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4868177a-303e-4079-a1c7-7c62e3960074 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:27.566587 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4868177a-303e-4079-a1c7-7c62e3960074 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:27.818058 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4868177a-303e-4079-a1c7-7c62e3960074 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "POST /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265584 Jun 24 08:50:27.818761 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 417/858] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Jun 24 08:50:27 2022] POST /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:28.106966 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-72219ad6-0dd8-471b-801f-ebbaa4ab64ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:28.107596 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-72219ad6-0dd8-471b-801f-ebbaa4ab64ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:28.113548 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-72219ad6-0dd8-471b-801f-ebbaa4ab64ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:28.113991 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-72219ad6-0dd8-471b-801f-ebbaa4ab64ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:28.114736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-72219ad6-0dd8-471b-801f-ebbaa4ab64ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:28.115161 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-72219ad6-0dd8-471b-801f-ebbaa4ab64ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:28.243416 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-72219ad6-0dd8-471b-801f-ebbaa4ab64ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:28.252044 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-72219ad6-0dd8-471b-801f-ebbaa4ab64ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:28.253618 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-72219ad6-0dd8-471b-801f-ebbaa4ab64ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:28.254776 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-72219ad6-0dd8-471b-801f-ebbaa4ab64ea tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.151668 Jun 24 08:50:28.255371 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 442/859] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:28 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:28.680682 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-77467a95-02ac-4718-b19c-1697dd40cada req-67599f4d-e18b-4378-988d-a7187379efb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8f47c2-c495-4707-8867-99604c4a1e73", "name": "network-vif-plugged", "status": "completed", "tag": "ddb01264-6505-4ff1-b632-85b797417418"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:28.689679 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-77467a95-02ac-4718-b19c-1697dd40cada req-67599f4d-e18b-4378-988d-a7187379efb0 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:28.690124 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-77467a95-02ac-4718-b19c-1697dd40cada req-67599f4d-e18b-4378-988d-a7187379efb0 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:28.850324 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-77467a95-02ac-4718-b19c-1697dd40cada req-67599f4d-e18b-4378-988d-a7187379efb0 service nova] Creating event network-vif-plugged:ddb01264-6505-4ff1-b632-85b797417418 for instance 9e8f47c2-c495-4707-8867-99604c4a1e73 on hv-cinder-84517 Jun 24 08:50:28.855082 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-77467a95-02ac-4718-b19c-1697dd40cada req-67599f4d-e18b-4378-988d-a7187379efb0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178969 Jun 24 08:50:28.855769 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 418/860] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:29.273175 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0b1c91a6-abc7-4466-a433-fee0e8de65fb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:29.273783 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0b1c91a6-abc7-4466-a433-fee0e8de65fb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:29.279926 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0b1c91a6-abc7-4466-a433-fee0e8de65fb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:29.280375 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0b1c91a6-abc7-4466-a433-fee0e8de65fb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:29.281129 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0b1c91a6-abc7-4466-a433-fee0e8de65fb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:29.281564 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0b1c91a6-abc7-4466-a433-fee0e8de65fb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:29.405827 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0b1c91a6-abc7-4466-a433-fee0e8de65fb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:29.414271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0b1c91a6-abc7-4466-a433-fee0e8de65fb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:29.415817 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0b1c91a6-abc7-4466-a433-fee0e8de65fb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:29.416969 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0b1c91a6-abc7-4466-a433-fee0e8de65fb tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.147703 Jun 24 08:50:29.417520 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 443/861] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:29 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:30.435963 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7fc47c84-0b61-4b06-ba93-b3f19aa62a9e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:30.436680 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7fc47c84-0b61-4b06-ba93-b3f19aa62a9e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:30.442804 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7fc47c84-0b61-4b06-ba93-b3f19aa62a9e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:30.443281 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7fc47c84-0b61-4b06-ba93-b3f19aa62a9e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:30.444032 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7fc47c84-0b61-4b06-ba93-b3f19aa62a9e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:30.444465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7fc47c84-0b61-4b06-ba93-b3f19aa62a9e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:30.574727 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7fc47c84-0b61-4b06-ba93-b3f19aa62a9e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:30.582606 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7fc47c84-0b61-4b06-ba93-b3f19aa62a9e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:30.584129 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7fc47c84-0b61-4b06-ba93-b3f19aa62a9e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:30.585262 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7fc47c84-0b61-4b06-ba93-b3f19aa62a9e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.154103 Jun 24 08:50:30.586211 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 419/862] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:30 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:31.603303 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6f472563-5fd5-4724-b770-ed325930d37c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:31.603920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6f472563-5fd5-4724-b770-ed325930d37c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:31.609919 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6f472563-5fd5-4724-b770-ed325930d37c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:31.610366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6f472563-5fd5-4724-b770-ed325930d37c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:31.611661 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6f472563-5fd5-4724-b770-ed325930d37c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:31.612094 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6f472563-5fd5-4724-b770-ed325930d37c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:31.744411 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6f472563-5fd5-4724-b770-ed325930d37c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:31.753214 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6f472563-5fd5-4724-b770-ed325930d37c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:31.754712 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6f472563-5fd5-4724-b770-ed325930d37c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:31.756020 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6f472563-5fd5-4724-b770-ed325930d37c tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1727 microversion: 2.20 time: 0.156644 Jun 24 08:50:31.756569 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 444/863] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:31 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:32.774130 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-184536ab-a793-436e-b646-ecf6fa3d86b6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:32.774854 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-184536ab-a793-436e-b646-ecf6fa3d86b6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:32.781223 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-184536ab-a793-436e-b646-ecf6fa3d86b6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:32.781663 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-184536ab-a793-436e-b646-ecf6fa3d86b6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:32.782409 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-184536ab-a793-436e-b646-ecf6fa3d86b6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:32.782835 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-184536ab-a793-436e-b646-ecf6fa3d86b6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:32.910552 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-184536ab-a793-436e-b646-ecf6fa3d86b6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:32.918290 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-184536ab-a793-436e-b646-ecf6fa3d86b6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:32.919814 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-184536ab-a793-436e-b646-ecf6fa3d86b6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:32.920966 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-184536ab-a793-436e-b646-ecf6fa3d86b6 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1714 microversion: 2.20 time: 0.150771 Jun 24 08:50:32.921512 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 420/864] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:32 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:35.318614 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b53fe5b8-45ff-4df4-b38e-4cb2a613c142 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:35.324684 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b53fe5b8-45ff-4df4-b38e-4cb2a613c142 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:35.325134 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b53fe5b8-45ff-4df4-b38e-4cb2a613c142 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:35.383528 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b53fe5b8-45ff-4df4-b38e-4cb2a613c142 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Going to try to stop instance {{(pid=124379) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 08:50:35.424688 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b53fe5b8-45ff-4df4-b38e-4cb2a613c142 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "POST /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/action" status: 202 len: 0 microversion: 2.1 time: 0.110051 Jun 24 08:50:35.425294 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 445/865] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Jun 24 08:50:35 2022] POST /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:50:35.433822 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fffc2a56-9922-4881-89da-dea53c383f8b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:35.434396 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fffc2a56-9922-4881-89da-dea53c383f8b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:35.437006 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:35.444247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fffc2a56-9922-4881-89da-dea53c383f8b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:35.444697 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fffc2a56-9922-4881-89da-dea53c383f8b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:35.445574 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fffc2a56-9922-4881-89da-dea53c383f8b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:35.446043 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fffc2a56-9922-4881-89da-dea53c383f8b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:35.572574 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fffc2a56-9922-4881-89da-dea53c383f8b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:35.580597 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fffc2a56-9922-4881-89da-dea53c383f8b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.150687 Jun 24 08:50:35.581154 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 421/866] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:35 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:36.598471 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2c915e7d-0eab-4de4-8d28-6f65d620bc09 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:36.599168 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2c915e7d-0eab-4de4-8d28-6f65d620bc09 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:36.601085 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=34 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:36.606829 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2c915e7d-0eab-4de4-8d28-6f65d620bc09 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:36.607301 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2c915e7d-0eab-4de4-8d28-6f65d620bc09 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:36.608066 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2c915e7d-0eab-4de4-8d28-6f65d620bc09 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:36.608527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2c915e7d-0eab-4de4-8d28-6f65d620bc09 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:36.740420 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-2c915e7d-0eab-4de4-8d28-6f65d620bc09 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:36.748394 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2c915e7d-0eab-4de4-8d28-6f65d620bc09 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.154221 Jun 24 08:50:36.748959 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 446/867] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:36 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:37.765833 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bfdc7465-6db6-4e1a-add7-25bb6f949466 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:37.766466 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bfdc7465-6db6-4e1a-add7-25bb6f949466 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:37.773415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bfdc7465-6db6-4e1a-add7-25bb6f949466 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:37.773862 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bfdc7465-6db6-4e1a-add7-25bb6f949466 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:37.774610 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bfdc7465-6db6-4e1a-add7-25bb6f949466 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:37.775042 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bfdc7465-6db6-4e1a-add7-25bb6f949466 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:37.907400 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bfdc7465-6db6-4e1a-add7-25bb6f949466 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:37.915720 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bfdc7465-6db6-4e1a-add7-25bb6f949466 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.153781 Jun 24 08:50:37.916270 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 422/868] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:37 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:38.933052 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-98db4fc3-91b4-4a93-96cf-e3f854ca5dd3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:38.933663 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-98db4fc3-91b4-4a93-96cf-e3f854ca5dd3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:38.939691 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-98db4fc3-91b4-4a93-96cf-e3f854ca5dd3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:38.940137 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-98db4fc3-91b4-4a93-96cf-e3f854ca5dd3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:38.940903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-98db4fc3-91b4-4a93-96cf-e3f854ca5dd3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:38.941339 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-98db4fc3-91b4-4a93-96cf-e3f854ca5dd3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:39.072011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-98db4fc3-91b4-4a93-96cf-e3f854ca5dd3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:39.080398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-98db4fc3-91b4-4a93-96cf-e3f854ca5dd3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.151285 Jun 24 08:50:39.080959 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 447/869] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:38 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:40.097949 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cf05cfd6-c9d1-4e8f-acd3-df94c90b2db0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:40.098545 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cf05cfd6-c9d1-4e8f-acd3-df94c90b2db0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:40.104993 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf05cfd6-c9d1-4e8f-acd3-df94c90b2db0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:40.105447 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf05cfd6-c9d1-4e8f-acd3-df94c90b2db0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:40.106213 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf05cfd6-c9d1-4e8f-acd3-df94c90b2db0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:40.106651 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf05cfd6-c9d1-4e8f-acd3-df94c90b2db0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:40.235158 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cf05cfd6-c9d1-4e8f-acd3-df94c90b2db0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:40.243539 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cf05cfd6-c9d1-4e8f-acd3-df94c90b2db0 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.149476 Jun 24 08:50:40.244092 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 423/870] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:40 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:41.259984 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-515a2f13-2f54-4053-b54c-b3bca0146ef2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:41.260592 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-515a2f13-2f54-4053-b54c-b3bca0146ef2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:41.266631 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-515a2f13-2f54-4053-b54c-b3bca0146ef2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:41.267677 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-515a2f13-2f54-4053-b54c-b3bca0146ef2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:41.268424 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-515a2f13-2f54-4053-b54c-b3bca0146ef2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:41.268849 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-515a2f13-2f54-4053-b54c-b3bca0146ef2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:41.399139 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-515a2f13-2f54-4053-b54c-b3bca0146ef2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:41.406986 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-515a2f13-2f54-4053-b54c-b3bca0146ef2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.150794 Jun 24 08:50:41.407574 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 448/871] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:41 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:42.423477 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-095282de-9846-4994-90ba-9bbf495099ce tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:42.424343 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-095282de-9846-4994-90ba-9bbf495099ce tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:42.430848 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-095282de-9846-4994-90ba-9bbf495099ce tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:42.431257 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-095282de-9846-4994-90ba-9bbf495099ce tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:42.432011 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-095282de-9846-4994-90ba-9bbf495099ce tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:42.432446 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-095282de-9846-4994-90ba-9bbf495099ce tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:42.560928 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-095282de-9846-4994-90ba-9bbf495099ce tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:42.569396 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-095282de-9846-4994-90ba-9bbf495099ce tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.149989 Jun 24 08:50:42.569958 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 424/872] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:42 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:43.585767 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bfe27a55-0643-40f9-978c-1d626234778c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:43.586408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bfe27a55-0643-40f9-978c-1d626234778c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:43.592659 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bfe27a55-0643-40f9-978c-1d626234778c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:43.593101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bfe27a55-0643-40f9-978c-1d626234778c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:43.593856 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bfe27a55-0643-40f9-978c-1d626234778c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:43.594279 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bfe27a55-0643-40f9-978c-1d626234778c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:43.721770 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bfe27a55-0643-40f9-978c-1d626234778c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:43.729818 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bfe27a55-0643-40f9-978c-1d626234778c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.147798 Jun 24 08:50:43.730381 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 449/873] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:43 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:44.747532 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-40523301-56ff-4748-9cf9-feeb15d1f2e2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:44.748133 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-40523301-56ff-4748-9cf9-feeb15d1f2e2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:44.759755 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40523301-56ff-4748-9cf9-feeb15d1f2e2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:44.759755 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40523301-56ff-4748-9cf9-feeb15d1f2e2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:44.759755 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40523301-56ff-4748-9cf9-feeb15d1f2e2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:44.759755 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-40523301-56ff-4748-9cf9-feeb15d1f2e2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:44.891381 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-40523301-56ff-4748-9cf9-feeb15d1f2e2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:44.899908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-40523301-56ff-4748-9cf9-feeb15d1f2e2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.156924 Jun 24 08:50:44.900460 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 425/874] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:44 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:45.917253 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-72927117-9b40-4282-a8ec-ac0c32ab21fe tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:45.917867 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-72927117-9b40-4282-a8ec-ac0c32ab21fe tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:45.924705 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-72927117-9b40-4282-a8ec-ac0c32ab21fe tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:45.925151 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-72927117-9b40-4282-a8ec-ac0c32ab21fe tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:45.926015 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-72927117-9b40-4282-a8ec-ac0c32ab21fe tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:45.926456 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-72927117-9b40-4282-a8ec-ac0c32ab21fe tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:46.055738 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-72927117-9b40-4282-a8ec-ac0c32ab21fe tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:46.063685 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-72927117-9b40-4282-a8ec-ac0c32ab21fe tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.150274 Jun 24 08:50:46.064825 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 450/875] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:45 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:47.081266 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5274d32f-439f-4e3a-8de0-98e8856d2b6f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:47.081811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5274d32f-439f-4e3a-8de0-98e8856d2b6f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:47.088181 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5274d32f-439f-4e3a-8de0-98e8856d2b6f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:47.088626 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5274d32f-439f-4e3a-8de0-98e8856d2b6f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:47.089375 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5274d32f-439f-4e3a-8de0-98e8856d2b6f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:47.089806 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5274d32f-439f-4e3a-8de0-98e8856d2b6f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:47.214570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5274d32f-439f-4e3a-8de0-98e8856d2b6f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:47.222932 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5274d32f-439f-4e3a-8de0-98e8856d2b6f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.145593 Jun 24 08:50:47.223520 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 426/876] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:47 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:48.239632 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d20dadb8-6e64-45d1-b4b2-d9bf1ff6a9c3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:48.240254 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d20dadb8-6e64-45d1-b4b2-d9bf1ff6a9c3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:48.246384 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d20dadb8-6e64-45d1-b4b2-d9bf1ff6a9c3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:48.246823 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d20dadb8-6e64-45d1-b4b2-d9bf1ff6a9c3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:48.247626 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d20dadb8-6e64-45d1-b4b2-d9bf1ff6a9c3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:48.248058 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d20dadb8-6e64-45d1-b4b2-d9bf1ff6a9c3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:48.375938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d20dadb8-6e64-45d1-b4b2-d9bf1ff6a9c3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:48.383813 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d20dadb8-6e64-45d1-b4b2-d9bf1ff6a9c3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.148049 Jun 24 08:50:48.384370 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 451/877] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:48 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:49.401345 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e2521916-526e-422c-b835-14d2a48e8014 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:49.401988 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e2521916-526e-422c-b835-14d2a48e8014 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:49.409054 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2521916-526e-422c-b835-14d2a48e8014 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:49.409489 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2521916-526e-422c-b835-14d2a48e8014 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:49.410258 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2521916-526e-422c-b835-14d2a48e8014 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:49.410693 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2521916-526e-422c-b835-14d2a48e8014 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:49.535047 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e2521916-526e-422c-b835-14d2a48e8014 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:49.542807 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e2521916-526e-422c-b835-14d2a48e8014 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.145349 Jun 24 08:50:49.543389 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 427/878] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:49 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:50.560232 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-04a65840-e42c-4656-bb05-123b44565c56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:50.560844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-04a65840-e42c-4656-bb05-123b44565c56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:50.567367 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-04a65840-e42c-4656-bb05-123b44565c56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:50.567811 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-04a65840-e42c-4656-bb05-123b44565c56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:50.568560 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-04a65840-e42c-4656-bb05-123b44565c56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:50.568988 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-04a65840-e42c-4656-bb05-123b44565c56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:50.694819 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-04a65840-e42c-4656-bb05-123b44565c56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:50.702673 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-04a65840-e42c-4656-bb05-123b44565c56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.146262 Jun 24 08:50:50.703274 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 452/879] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:50 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:51.719695 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cebd289a-60f5-4290-81da-364b75209112 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:51.720815 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cebd289a-60f5-4290-81da-364b75209112 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:51.727146 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cebd289a-60f5-4290-81da-364b75209112 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:51.727631 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cebd289a-60f5-4290-81da-364b75209112 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:51.728390 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cebd289a-60f5-4290-81da-364b75209112 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:51.728826 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cebd289a-60f5-4290-81da-364b75209112 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:51.852217 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cebd289a-60f5-4290-81da-364b75209112 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:51.860077 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cebd289a-60f5-4290-81da-364b75209112 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.144278 Jun 24 08:50:51.860694 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 428/880] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:51 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:52.877939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4741af8b-2280-428f-a0a7-b4ae474c7ca4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:52.878556 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4741af8b-2280-428f-a0a7-b4ae474c7ca4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:52.884875 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4741af8b-2280-428f-a0a7-b4ae474c7ca4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:52.885328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4741af8b-2280-428f-a0a7-b4ae474c7ca4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:52.886088 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4741af8b-2280-428f-a0a7-b4ae474c7ca4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:52.886522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4741af8b-2280-428f-a0a7-b4ae474c7ca4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:53.010263 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4741af8b-2280-428f-a0a7-b4ae474c7ca4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:53.018239 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4741af8b-2280-428f-a0a7-b4ae474c7ca4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.144809 Jun 24 08:50:53.018799 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 453/881] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:52 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:54.035433 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-df09d5b4-57a7-4819-a9a1-9f9a41ccaeea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:54.036062 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-df09d5b4-57a7-4819-a9a1-9f9a41ccaeea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:54.042435 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df09d5b4-57a7-4819-a9a1-9f9a41ccaeea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:54.042881 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df09d5b4-57a7-4819-a9a1-9f9a41ccaeea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:54.043662 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df09d5b4-57a7-4819-a9a1-9f9a41ccaeea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:54.044090 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-df09d5b4-57a7-4819-a9a1-9f9a41ccaeea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:54.179640 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-df09d5b4-57a7-4819-a9a1-9f9a41ccaeea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:54.187589 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-df09d5b4-57a7-4819-a9a1-9f9a41ccaeea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.156106 Jun 24 08:50:54.188142 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 429/882] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:54 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:54.607367 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-318989084", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1167158324", "security_groups": [{"name": "tempest-secgroup-smoke-1577723221"}], "block_device_mapping_v2": [{"uuid": "c3fec8d7-632e-4743-b32a-8f15435a481e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ee4277a5-1041-408a-bfe3-ce6a3f8905d0"}]}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:54.714100 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] validate_networks() for [('ee4277a5-1041-408a-bfe3-ce6a3f8905d0', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:50:55.070518 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:50:55.070930 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:50:55.071430 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:50:55.071830 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:50:55.072232 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:50:55.081451 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:55.081884 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:55.082660 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:55.083082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:55.100556 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Getting quotas for project 891980c3542d4223a15461bb7c5dcff9. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:50:55.104425 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Getting quotas for user 7f65bea891fb461086d6a60177ff2d65 and project 891980c3542d4223a15461bb7c5dcff9. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:50:55.159760 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:50:55.161924 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c3fec8d7-632e-4743-b32a-8f15435a481e',volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:50:55.207265 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-81a9cba2-713e-46ed-8a59-cf6068353e43 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:55.208077 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-81a9cba2-713e-46ed-8a59-cf6068353e43 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:55.214853 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81a9cba2-713e-46ed-8a59-cf6068353e43 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:55.215549 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81a9cba2-713e-46ed-8a59-cf6068353e43 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:55.216558 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81a9cba2-713e-46ed-8a59-cf6068353e43 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:55.217111 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81a9cba2-713e-46ed-8a59-cf6068353e43 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:55.291691 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-98d6359c-7973-4424-ab59-38b689784e63 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.688160 Jun 24 08:50:55.292522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 454/883] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:50:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:50:55.302659 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c3812791-45ba-4f15-a12c-fb2406d5ecb3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:55.303044 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c3812791-45ba-4f15-a12c-fb2406d5ecb3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:55.366399 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c3812791-45ba-4f15-a12c-fb2406d5ecb3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:55.374394 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c3812791-45ba-4f15-a12c-fb2406d5ecb3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1094 microversion: 2.1 time: 0.075902 Jun 24 08:50:55.375788 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 455/884] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:55 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:55.383825 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-81a9cba2-713e-46ed-8a59-cf6068353e43 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:55.392498 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-81a9cba2-713e-46ed-8a59-cf6068353e43 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.190081 Jun 24 08:50:55.393222 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 430/885] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:55 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:56.392445 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3fa0b88a-d7ba-4865-8a5b-06179d2b4c23 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:56.393152 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3fa0b88a-d7ba-4865-8a5b-06179d2b4c23 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:56.402525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3fa0b88a-d7ba-4865-8a5b-06179d2b4c23 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.403532 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3fa0b88a-d7ba-4865-8a5b-06179d2b4c23 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.412111 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cebbaa4a-9902-4673-b71b-be7da28685e5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:56.412738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cebbaa4a-9902-4673-b71b-be7da28685e5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:56.417711 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3fa0b88a-d7ba-4865-8a5b-06179d2b4c23 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.418364 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3fa0b88a-d7ba-4865-8a5b-06179d2b4c23 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.420515 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cebbaa4a-9902-4673-b71b-be7da28685e5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.420838 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cebbaa4a-9902-4673-b71b-be7da28685e5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.421592 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cebbaa4a-9902-4673-b71b-be7da28685e5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.422027 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cebbaa4a-9902-4673-b71b-be7da28685e5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.514629 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-3fa0b88a-d7ba-4865-8a5b-06179d2b4c23 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:56.522406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3fa0b88a-d7ba-4865-8a5b-06179d2b4c23 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1210 microversion: 2.1 time: 0.134268 Jun 24 08:50:56.523171 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 456/886] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:56 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1210 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:56.583661 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cebbaa4a-9902-4673-b71b-be7da28685e5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:56.591936 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cebbaa4a-9902-4673-b71b-be7da28685e5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.185690 Jun 24 08:50:56.592440 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 431/887] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:56 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:57.539561 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-15301ee0-39ad-45e3-9f40-82a96e176b4d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:57.540268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-15301ee0-39ad-45e3-9f40-82a96e176b4d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:57.546697 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15301ee0-39ad-45e3-9f40-82a96e176b4d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.547433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15301ee0-39ad-45e3-9f40-82a96e176b4d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.548411 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15301ee0-39ad-45e3-9f40-82a96e176b4d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.549703 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15301ee0-39ad-45e3-9f40-82a96e176b4d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.570042 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:57.609668 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8b7667ab-653f-4eee-a538-0f9455ee97e7 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:57.610299 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8b7667ab-653f-4eee-a538-0f9455ee97e7 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:57.616800 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b7667ab-653f-4eee-a538-0f9455ee97e7 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.617694 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b7667ab-653f-4eee-a538-0f9455ee97e7 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.618199 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b7667ab-653f-4eee-a538-0f9455ee97e7 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.618831 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8b7667ab-653f-4eee-a538-0f9455ee97e7 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.623774 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:57.768165 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-15301ee0-39ad-45e3-9f40-82a96e176b4d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:57.777441 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-15301ee0-39ad-45e3-9f40-82a96e176b4d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1266 microversion: 2.1 time: 0.241630 Jun 24 08:50:57.778242 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 457/888] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:57 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:57.784321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-1e42f753-051b-4895-8ffd-2e2c352b5833 req-c582446e-a416-4fde-94f0-4cf3599c7dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f39324f-89be-4fb8-af15-a44da05f0f48", "tag": "3e005c82-378b-4b80-96f1-f4005830fe97"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:50:57.797648 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-1e42f753-051b-4895-8ffd-2e2c352b5833 req-c582446e-a416-4fde-94f0-4cf3599c7dce service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.798407 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-1e42f753-051b-4895-8ffd-2e2c352b5833 req-c582446e-a416-4fde-94f0-4cf3599c7dce service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.805350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8b7667ab-653f-4eee-a538-0f9455ee97e7 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:57.810437 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-1e42f753-051b-4895-8ffd-2e2c352b5833 req-c582446e-a416-4fde-94f0-4cf3599c7dce service nova] Creating event network-changed:3e005c82-378b-4b80-96f1-f4005830fe97 for instance 1f39324f-89be-4fb8-af15-a44da05f0f48 on hv-cinder-84517 Jun 24 08:50:57.814057 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8b7667ab-653f-4eee-a538-0f9455ee97e7 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.208246 Jun 24 08:50:57.815194 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 432/889] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:57 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:57.815501 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-1e42f753-051b-4895-8ffd-2e2c352b5833 req-c582446e-a416-4fde-94f0-4cf3599c7dce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035599 Jun 24 08:50:57.816155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 458/890] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:50:58.795180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ad8b01d3-c06a-4142-92b4-f93fe44f60fa tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:58.795819 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ad8b01d3-c06a-4142-92b4-f93fe44f60fa tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:58.803050 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad8b01d3-c06a-4142-92b4-f93fe44f60fa tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:58.803538 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad8b01d3-c06a-4142-92b4-f93fe44f60fa tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:58.804305 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad8b01d3-c06a-4142-92b4-f93fe44f60fa tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:58.804745 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ad8b01d3-c06a-4142-92b4-f93fe44f60fa tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:58.832530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-31a8b0c8-d097-4182-bba7-c7176bf3a44f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:58.833276 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-31a8b0c8-d097-4182-bba7-c7176bf3a44f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:58.839561 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31a8b0c8-d097-4182-bba7-c7176bf3a44f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:58.839998 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31a8b0c8-d097-4182-bba7-c7176bf3a44f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:58.840751 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31a8b0c8-d097-4182-bba7-c7176bf3a44f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:58.841178 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-31a8b0c8-d097-4182-bba7-c7176bf3a44f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:58.979878 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ad8b01d3-c06a-4142-92b4-f93fe44f60fa tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:58.988046 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ad8b01d3-c06a-4142-92b4-f93fe44f60fa tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1266 microversion: 2.1 time: 0.196669 Jun 24 08:50:58.988668 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 433/891] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:58 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:59.014607 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-31a8b0c8-d097-4182-bba7-c7176bf3a44f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:59.023199 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-31a8b0c8-d097-4182-bba7-c7176bf3a44f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.195510 Jun 24 08:50:59.023798 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 459/892] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:58 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:00.005120 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ff0c5fa4-1e61-4dda-b069-bea474944ea8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:00.005743 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ff0c5fa4-1e61-4dda-b069-bea474944ea8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:00.012305 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff0c5fa4-1e61-4dda-b069-bea474944ea8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:00.012754 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff0c5fa4-1e61-4dda-b069-bea474944ea8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:00.013515 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff0c5fa4-1e61-4dda-b069-bea474944ea8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:00.013952 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ff0c5fa4-1e61-4dda-b069-bea474944ea8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:00.040561 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b4c86979-22ea-4a02-9313-34c7c8c5ef4d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:00.041256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b4c86979-22ea-4a02-9313-34c7c8c5ef4d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:00.047309 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b4c86979-22ea-4a02-9313-34c7c8c5ef4d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:00.048465 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b4c86979-22ea-4a02-9313-34c7c8c5ef4d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:00.049732 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b4c86979-22ea-4a02-9313-34c7c8c5ef4d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:00.050158 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b4c86979-22ea-4a02-9313-34c7c8c5ef4d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:00.449526 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-ff0c5fa4-1e61-4dda-b069-bea474944ea8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:00.456982 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ff0c5fa4-1e61-4dda-b069-bea474944ea8 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1266 microversion: 2.1 time: 0.455766 Jun 24 08:51:00.457532 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 434/893] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:00 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1266 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:00.476322 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b4c86979-22ea-4a02-9313-34c7c8c5ef4d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:00.484198 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b4c86979-22ea-4a02-9313-34c7c8c5ef4d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.447381 Jun 24 08:51:00.484752 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 460/894] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:00 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:01.473688 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2d15a9e1-f9dd-4484-9826-973ffb895ba7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:01.474223 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2d15a9e1-f9dd-4484-9826-973ffb895ba7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:01.480664 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d15a9e1-f9dd-4484-9826-973ffb895ba7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:01.481105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d15a9e1-f9dd-4484-9826-973ffb895ba7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:01.481851 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d15a9e1-f9dd-4484-9826-973ffb895ba7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:01.482276 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2d15a9e1-f9dd-4484-9826-973ffb895ba7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:01.501790 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-86536726-1925-4245-98de-5b43d6dfbeca tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:01.502394 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-86536726-1925-4245-98de-5b43d6dfbeca tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:01.508280 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-86536726-1925-4245-98de-5b43d6dfbeca tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:01.508699 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-86536726-1925-4245-98de-5b43d6dfbeca tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:01.509450 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-86536726-1925-4245-98de-5b43d6dfbeca tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:01.509904 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-86536726-1925-4245-98de-5b43d6dfbeca tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:01.664387 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2d15a9e1-f9dd-4484-9826-973ffb895ba7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:01.671881 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2d15a9e1-f9dd-4484-9826-973ffb895ba7 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1266 microversion: 2.1 time: 0.202167 Jun 24 08:51:01.672438 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 435/895] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:01 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:01.686012 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-86536726-1925-4245-98de-5b43d6dfbeca tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:01.694604 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-86536726-1925-4245-98de-5b43d6dfbeca tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1723 microversion: 2.1 time: 0.196995 Jun 24 08:51:01.695170 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 461/896] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:01 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:02.689430 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e542ca30-d72f-45a3-8764-d4795cc6748e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:02.690044 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e542ca30-d72f-45a3-8764-d4795cc6748e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:02.696507 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e542ca30-d72f-45a3-8764-d4795cc6748e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:02.696952 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e542ca30-d72f-45a3-8764-d4795cc6748e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:02.697709 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e542ca30-d72f-45a3-8764-d4795cc6748e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:02.698145 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e542ca30-d72f-45a3-8764-d4795cc6748e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:02.711649 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cb158c0a-5462-4241-aa34-0604efff125c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:02.712258 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cb158c0a-5462-4241-aa34-0604efff125c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:02.718210 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cb158c0a-5462-4241-aa34-0604efff125c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:02.718720 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cb158c0a-5462-4241-aa34-0604efff125c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:02.719510 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cb158c0a-5462-4241-aa34-0604efff125c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:02.719942 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cb158c0a-5462-4241-aa34-0604efff125c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:02.903155 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e542ca30-d72f-45a3-8764-d4795cc6748e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:02.906081 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cb158c0a-5462-4241-aa34-0604efff125c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:02.911075 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e542ca30-d72f-45a3-8764-d4795cc6748e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1266 microversion: 2.1 time: 0.226013 Jun 24 08:51:02.911664 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 436/897] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:02 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:02.914463 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cb158c0a-5462-4241-aa34-0604efff125c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1700 microversion: 2.1 time: 0.206610 Jun 24 08:51:02.915118 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 462/898] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:02 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1700 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:02.930831 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c68de455-47af-471f-ab2b-ec283f4b124e tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:02.936693 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c68de455-47af-471f-ab2b-ec283f4b124e tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:02.937139 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c68de455-47af-471f-ab2b-ec283f4b124e tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:02.996308 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c68de455-47af-471f-ab2b-ec283f4b124e tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Going to try to start instance {{(pid=124380) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 08:51:03.037821 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c68de455-47af-471f-ab2b-ec283f4b124e tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "POST /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/action" status: 202 len: 0 microversion: 2.1 time: 0.110503 Jun 24 08:51:03.038425 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 437/899] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Jun 24 08:51:02 2022] POST /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:51:03.046506 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-939cc19e-bc61-48e7-99ec-ffad1d56d6bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:03.047393 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-939cc19e-bc61-48e7-99ec-ffad1d56d6bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:03.054822 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-939cc19e-bc61-48e7-99ec-ffad1d56d6bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.055395 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-939cc19e-bc61-48e7-99ec-ffad1d56d6bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:03.056176 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-939cc19e-bc61-48e7-99ec-ffad1d56d6bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.056601 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-939cc19e-bc61-48e7-99ec-ffad1d56d6bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:03.198891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-939cc19e-bc61-48e7-99ec-ffad1d56d6bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:03.207040 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-939cc19e-bc61-48e7-99ec-ffad1d56d6bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1709 microversion: 2.1 time: 0.164279 Jun 24 08:51:03.207662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 463/900] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:03 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1709 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:03.929433 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bbda24d2-4735-405a-baaa-1400b095bf64 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:03.930129 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bbda24d2-4735-405a-baaa-1400b095bf64 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:03.936176 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bbda24d2-4735-405a-baaa-1400b095bf64 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.936619 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bbda24d2-4735-405a-baaa-1400b095bf64 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:03.937369 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bbda24d2-4735-405a-baaa-1400b095bf64 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.937800 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bbda24d2-4735-405a-baaa-1400b095bf64 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:04.071387 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bbda24d2-4735-405a-baaa-1400b095bf64 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:04.078856 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bbda24d2-4735-405a-baaa-1400b095bf64 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1266 microversion: 2.1 time: 0.154440 Jun 24 08:51:04.079929 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 438/901] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:03 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:04.224618 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8dbb4c68-5810-4bac-a5fc-dfaec4ecc38c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:04.225225 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8dbb4c68-5810-4bac-a5fc-dfaec4ecc38c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:04.231240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8dbb4c68-5810-4bac-a5fc-dfaec4ecc38c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:04.231687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8dbb4c68-5810-4bac-a5fc-dfaec4ecc38c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:04.232440 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8dbb4c68-5810-4bac-a5fc-dfaec4ecc38c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:04.232872 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8dbb4c68-5810-4bac-a5fc-dfaec4ecc38c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:04.362112 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8dbb4c68-5810-4bac-a5fc-dfaec4ecc38c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:04.370019 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8dbb4c68-5810-4bac-a5fc-dfaec4ecc38c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1709 microversion: 2.1 time: 0.149278 Jun 24 08:51:04.370579 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 464/902] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:04 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1709 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:05.096565 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-5d7c480d-1259-4cd2-b4db-aaf0f02ff32e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:05.097182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-5d7c480d-1259-4cd2-b4db-aaf0f02ff32e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:05.103777 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5d7c480d-1259-4cd2-b4db-aaf0f02ff32e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:05.104221 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5d7c480d-1259-4cd2-b4db-aaf0f02ff32e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:05.104977 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5d7c480d-1259-4cd2-b4db-aaf0f02ff32e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:05.105409 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-5d7c480d-1259-4cd2-b4db-aaf0f02ff32e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:05.232198 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-5d7c480d-1259-4cd2-b4db-aaf0f02ff32e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:05.240241 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-5d7c480d-1259-4cd2-b4db-aaf0f02ff32e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1266 microversion: 2.1 time: 0.148121 Jun 24 08:51:05.240806 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 439/903] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:05 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:05.389861 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e11e06ff-8902-4a28-8206-284e235c3d2a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:05.390389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e11e06ff-8902-4a28-8206-284e235c3d2a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:05.392857 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:05.393563 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=8 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:05.400036 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e11e06ff-8902-4a28-8206-284e235c3d2a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:05.400478 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e11e06ff-8902-4a28-8206-284e235c3d2a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:05.401225 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e11e06ff-8902-4a28-8206-284e235c3d2a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:05.401652 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e11e06ff-8902-4a28-8206-284e235c3d2a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:05.533923 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e11e06ff-8902-4a28-8206-284e235c3d2a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:05.541747 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e11e06ff-8902-4a28-8206-284e235c3d2a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1713 microversion: 2.1 time: 0.155897 Jun 24 08:51:05.542300 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 465/904] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:05 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1713 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:06.257512 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-84d28c5f-b023-40ce-b259-83370029554d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:06.258130 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-84d28c5f-b023-40ce-b259-83370029554d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:06.260526 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=38 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:06.265819 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84d28c5f-b023-40ce-b259-83370029554d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:06.266265 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84d28c5f-b023-40ce-b259-83370029554d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:06.267075 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84d28c5f-b023-40ce-b259-83370029554d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:06.267532 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-84d28c5f-b023-40ce-b259-83370029554d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:06.393769 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-84d28c5f-b023-40ce-b259-83370029554d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:06.401103 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-84d28c5f-b023-40ce-b259-83370029554d tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1266 microversion: 2.1 time: 0.147480 Jun 24 08:51:06.401657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 440/905] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:06 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:07.419505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-24c92e6b-6fcf-487c-b916-47c67995c63f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:07.420117 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-24c92e6b-6fcf-487c-b916-47c67995c63f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:07.422004 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:07.428090 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24c92e6b-6fcf-487c-b916-47c67995c63f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:07.428560 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24c92e6b-6fcf-487c-b916-47c67995c63f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:07.429321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24c92e6b-6fcf-487c-b916-47c67995c63f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:07.429747 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-24c92e6b-6fcf-487c-b916-47c67995c63f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:07.567885 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-24c92e6b-6fcf-487c-b916-47c67995c63f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:07.575543 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-24c92e6b-6fcf-487c-b916-47c67995c63f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1266 microversion: 2.1 time: 0.160693 Jun 24 08:51:07.576110 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 466/906] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:07 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:08.591878 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8421c988-daf2-4194-beb1-244778e0aec1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:08.592494 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8421c988-daf2-4194-beb1-244778e0aec1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:08.599012 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8421c988-daf2-4194-beb1-244778e0aec1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:08.599488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8421c988-daf2-4194-beb1-244778e0aec1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:08.600253 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8421c988-daf2-4194-beb1-244778e0aec1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:08.600688 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8421c988-daf2-4194-beb1-244778e0aec1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:08.732522 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8421c988-daf2-4194-beb1-244778e0aec1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:08.740453 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8421c988-daf2-4194-beb1-244778e0aec1 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1266 microversion: 2.1 time: 0.152503 Jun 24 08:51:08.741013 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 441/907] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:08 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:08.973586 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-0e420b38-183e-4a23-b169-7832d1ace580 req-88b3406b-8fc0-4d26-a6d5-b6ede78cff20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f39324f-89be-4fb8-af15-a44da05f0f48", "name": "network-vif-plugged", "status": "completed", "tag": "3e005c82-378b-4b80-96f1-f4005830fe97"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:08.982283 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0e420b38-183e-4a23-b169-7832d1ace580 req-88b3406b-8fc0-4d26-a6d5-b6ede78cff20 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:08.982512 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0e420b38-183e-4a23-b169-7832d1ace580 req-88b3406b-8fc0-4d26-a6d5-b6ede78cff20 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:08.996852 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-0e420b38-183e-4a23-b169-7832d1ace580 req-88b3406b-8fc0-4d26-a6d5-b6ede78cff20 service nova] Creating event network-vif-plugged:3e005c82-378b-4b80-96f1-f4005830fe97 for instance 1f39324f-89be-4fb8-af15-a44da05f0f48 on hv-cinder-84517 Jun 24 08:51:09.001806 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-0e420b38-183e-4a23-b169-7832d1ace580 req-88b3406b-8fc0-4d26-a6d5-b6ede78cff20 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032341 Jun 24 08:51:09.002390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 467/908] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:09.757611 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0bba4938-00a2-478f-8a58-b57f50c464de tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:09.758227 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0bba4938-00a2-478f-8a58-b57f50c464de tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:09.764709 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0bba4938-00a2-478f-8a58-b57f50c464de tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:09.765162 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0bba4938-00a2-478f-8a58-b57f50c464de tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:09.765956 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0bba4938-00a2-478f-8a58-b57f50c464de tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:09.766392 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0bba4938-00a2-478f-8a58-b57f50c464de tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:09.895593 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-0bba4938-00a2-478f-8a58-b57f50c464de tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:09.902999 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0bba4938-00a2-478f-8a58-b57f50c464de tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1266 microversion: 2.1 time: 0.149321 Jun 24 08:51:09.903713 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 442/909] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:09 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:10.920706 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-85a22ab0-d506-4d39-a315-8dd678e352f9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:10.921413 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-85a22ab0-d506-4d39-a315-8dd678e352f9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:10.927917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-85a22ab0-d506-4d39-a315-8dd678e352f9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:10.928366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-85a22ab0-d506-4d39-a315-8dd678e352f9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:10.929128 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-85a22ab0-d506-4d39-a315-8dd678e352f9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:10.929560 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-85a22ab0-d506-4d39-a315-8dd678e352f9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:11.061796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-85a22ab0-d506-4d39-a315-8dd678e352f9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:11.069748 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-85a22ab0-d506-4d39-a315-8dd678e352f9 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1452 microversion: 2.1 time: 0.153403 Jun 24 08:51:11.070308 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 468/910] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:10 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:11.086456 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-aaa271e2-bac8-4c83-be3d-3d1814fc15ce tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:11.087081 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-aaa271e2-bac8-4c83-be3d-3d1814fc15ce tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:11.093187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aaa271e2-bac8-4c83-be3d-3d1814fc15ce tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:11.093642 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aaa271e2-bac8-4c83-be3d-3d1814fc15ce tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:11.094403 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aaa271e2-bac8-4c83-be3d-3d1814fc15ce tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:11.094841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aaa271e2-bac8-4c83-be3d-3d1814fc15ce tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:11.228740 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-aaa271e2-bac8-4c83-be3d-3d1814fc15ce tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:11.236991 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-aaa271e2-bac8-4c83-be3d-3d1814fc15ce tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1452 microversion: 2.1 time: 0.153881 Jun 24 08:51:11.237576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 443/911] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:11 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:12.939968 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-f61d26e0-a821-454b-bb70-13b11ec36fbd req-198d0fcb-2bae-456f-8e65-43310c7dde1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f39324f-89be-4fb8-af15-a44da05f0f48", "tag": "3e005c82-378b-4b80-96f1-f4005830fe97"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:12.949131 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-f61d26e0-a821-454b-bb70-13b11ec36fbd req-198d0fcb-2bae-456f-8e65-43310c7dde1b service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:12.949573 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-f61d26e0-a821-454b-bb70-13b11ec36fbd req-198d0fcb-2bae-456f-8e65-43310c7dde1b service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:12.960201 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-f61d26e0-a821-454b-bb70-13b11ec36fbd req-198d0fcb-2bae-456f-8e65-43310c7dde1b service nova] Creating event network-changed:3e005c82-378b-4b80-96f1-f4005830fe97 for instance 1f39324f-89be-4fb8-af15-a44da05f0f48 on hv-cinder-84517 Jun 24 08:51:12.965139 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-f61d26e0-a821-454b-bb70-13b11ec36fbd req-198d0fcb-2bae-456f-8e65-43310c7dde1b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029599 Jun 24 08:51:12.965751 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 469/912] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:36.946174 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-39f2f2f0-c6e8-4d8f-93db-9f1e7135e425 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:36.947206 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-39f2f2f0-c6e8-4d8f-93db-9f1e7135e425 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:36.949856 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=7 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:36.950512 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:36.956155 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39f2f2f0-c6e8-4d8f-93db-9f1e7135e425 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:36.956606 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39f2f2f0-c6e8-4d8f-93db-9f1e7135e425 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:36.957365 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39f2f2f0-c6e8-4d8f-93db-9f1e7135e425 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:36.957799 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-39f2f2f0-c6e8-4d8f-93db-9f1e7135e425 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:36.986618 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-39f2f2f0-c6e8-4d8f-93db-9f1e7135e425 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044496 Jun 24 08:51:36.987802 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 444/913] 10.222.0.43 () {60 vars in 1342 bytes} [Fri Jun 24 08:51:36 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:37.040264 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=7 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:37.040997 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=65 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:37.045383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6fe461d3-d144-44ff-b50c-c300274d2559 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:37.045987 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6fe461d3-d144-44ff-b50c-c300274d2559 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:37.053740 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6fe461d3-d144-44ff-b50c-c300274d2559 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:37.054179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6fe461d3-d144-44ff-b50c-c300274d2559 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:37.054922 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6fe461d3-d144-44ff-b50c-c300274d2559 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:37.055383 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6fe461d3-d144-44ff-b50c-c300274d2559 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:37.078959 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6fe461d3-d144-44ff-b50c-c300274d2559 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:51:37.153222 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6fe461d3-d144-44ff-b50c-c300274d2559 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 204 len: 0 microversion: 2.20 time: 0.113603 Jun 24 08:51:37.153782 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 470/914] 10.222.0.43 () {60 vars in 1279 bytes} [Fri Jun 24 08:51:37 2022] DELETE /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 08:51:37.162748 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1761c32c-7c45-451d-9fa3-c490c05c885a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:37.163491 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1761c32c-7c45-451d-9fa3-c490c05c885a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:37.169428 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1761c32c-7c45-451d-9fa3-c490c05c885a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:37.169873 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1761c32c-7c45-451d-9fa3-c490c05c885a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:37.170624 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1761c32c-7c45-451d-9fa3-c490c05c885a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:37.171051 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1761c32c-7c45-451d-9fa3-c490c05c885a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:37.410898 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1761c32c-7c45-451d-9fa3-c490c05c885a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:37.418723 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1761c32c-7c45-451d-9fa3-c490c05c885a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:37.420246 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1761c32c-7c45-451d-9fa3-c490c05c885a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:37.421403 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1761c32c-7c45-451d-9fa3-c490c05c885a tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1720 microversion: 2.20 time: 0.263171 Jun 24 08:51:37.421949 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 445/915] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:37 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1720 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:38.442426 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-098d6f9c-8a0c-4b16-8c19-179c59b8ac07 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:38.443040 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-098d6f9c-8a0c-4b16-8c19-179c59b8ac07 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:38.449037 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-098d6f9c-8a0c-4b16-8c19-179c59b8ac07 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:38.449475 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-098d6f9c-8a0c-4b16-8c19-179c59b8ac07 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:38.450223 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-098d6f9c-8a0c-4b16-8c19-179c59b8ac07 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:38.450647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-098d6f9c-8a0c-4b16-8c19-179c59b8ac07 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:38.626799 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-098d6f9c-8a0c-4b16-8c19-179c59b8ac07 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:38.634622 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-098d6f9c-8a0c-4b16-8c19-179c59b8ac07 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:38.636225 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-098d6f9c-8a0c-4b16-8c19-179c59b8ac07 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:38.637372 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-098d6f9c-8a0c-4b16-8c19-179c59b8ac07 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1720 microversion: 2.20 time: 0.199840 Jun 24 08:51:38.637973 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 471/916] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:38 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1720 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:39.656165 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-16ec7974-825a-4cd7-8c37-75c12028e946 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:39.656788 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-16ec7974-825a-4cd7-8c37-75c12028e946 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:39.663442 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16ec7974-825a-4cd7-8c37-75c12028e946 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:39.663900 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16ec7974-825a-4cd7-8c37-75c12028e946 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:39.664673 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16ec7974-825a-4cd7-8c37-75c12028e946 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:39.665116 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-16ec7974-825a-4cd7-8c37-75c12028e946 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:39.735422 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-16ec7974-825a-4cd7-8c37-75c12028e946 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:39.743964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-16ec7974-825a-4cd7-8c37-75c12028e946 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:39.745490 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-16ec7974-825a-4cd7-8c37-75c12028e946 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12f0ce0a293f4114a90098985e5f21ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150883a8e55c459a9f41fc48f8f81b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:39.746644 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-16ec7974-825a-4cd7-8c37-75c12028e946 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 200 len: 1654 microversion: 2.20 time: 0.094428 Jun 24 08:51:39.747224 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 446/917] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:39 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 1654 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:40.186501 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-36b3b440-4378-4b8d-9d73-3bc7eb058dcf req-b270fa51-6e05-47a5-8ba6-a3587ace5d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e8f47c2-c495-4707-8867-99604c4a1e73", "name": "network-vif-deleted", "tag": "ddb01264-6505-4ff1-b632-85b797417418"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:40.195821 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-36b3b440-4378-4b8d-9d73-3bc7eb058dcf req-b270fa51-6e05-47a5-8ba6-a3587ace5d04 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:40.196373 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-36b3b440-4378-4b8d-9d73-3bc7eb058dcf req-b270fa51-6e05-47a5-8ba6-a3587ace5d04 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:40.210767 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-36b3b440-4378-4b8d-9d73-3bc7eb058dcf req-b270fa51-6e05-47a5-8ba6-a3587ace5d04 service nova] Creating event network-vif-deleted:ddb01264-6505-4ff1-b632-85b797417418 for instance 9e8f47c2-c495-4707-8867-99604c4a1e73 on hv-cinder-84517 Jun 24 08:51:40.215949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-36b3b440-4378-4b8d-9d73-3bc7eb058dcf req-b270fa51-6e05-47a5-8ba6-a3587ace5d04 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032912 Jun 24 08:51:40.216569 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 472/918] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:40.765833 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2c99a701-290a-4639-a9d7-ad8d383b6211 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:40.766406 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2c99a701-290a-4639-a9d7-ad8d383b6211 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:40.773144 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c99a701-290a-4639-a9d7-ad8d383b6211 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:40.773597 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c99a701-290a-4639-a9d7-ad8d383b6211 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:40.774371 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c99a701-290a-4639-a9d7-ad8d383b6211 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:40.774812 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2c99a701-290a-4639-a9d7-ad8d383b6211 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:40.789961 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-2c99a701-290a-4639-a9d7-ad8d383b6211 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] HTTP exception thrown: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2c99a701-290a-4639-a9d7-ad8d383b6211 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Request method failure captured: Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 HTTP/1.1 Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXjISBaZPnLTRFWfDFBrNoJb_9l8PMROGS9TZHCKbXDNj_v5GPbS_LWzfSeyv8QrRiiJ2p0EhwSb565cLn9CUiAAw9FDInOycXWZZ7kByah1En8fBZRCCnz_I_mA9HYiRd0eYq-Z9liDIEUACwUbJN36719ofSomjnY6gjuP30-gqB8 Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 150883a8e55c459a9f41fc48f8f81b0c Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:51:40.792105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:51:40.794465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_150883a8e55c459a9f41fc48f8f81b0c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:51:40.794465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:40.794465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 150883a8e55c459a9f41fc48f8f81b0c Jun 24 08:51:40.794465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:40.794465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeShelveTestJSON-779659428-project Jun 24 08:51:40.794465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:51:40.794465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:51:40.794465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 12f0ce0a293f4114a90098985e5f21ee Jun 24 08:51:40.794465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeShelveTestJSON-779659428-project Jun 24 08:51:40.794465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:51:40.794465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:40.794465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': '9e8f47c2-c495-4707-8867-99604c4a1e73'} Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:51:40.795488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:40.797431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:40.800191 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2c99a701-290a-4639-a9d7-ad8d383b6211 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Returning 404 to user: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:51:40.801487 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2c99a701-290a-4639-a9d7-ad8d383b6211 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 404 len: 111 microversion: 2.20 time: 0.039627 Jun 24 08:51:40.802051 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 447/919] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:40 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 24 08:51:40.811139 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d5218c11-10e7-4b56-b550-53eabec4ec98 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '.version_select at 0x7fb75c8f0700>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:40.814409 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d5218c11-10e7-4b56-b550-53eabec4ec98 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [166bf658-36ed-4a15-8767-c730a7e4a0e0] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 24 08:51:41.821938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [None req-d5218c11-10e7-4b56-b550-53eabec4ec98 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [166bf658-36ed-4a15-8767-c730a7e4a0e0] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 52464. Jun 24 08:51:41.839110 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d5218c11-10e7-4b56-b550-53eabec4ec98 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-107141842" status: 204 len: 0 microversion: 2.20 time: 1.032209 Jun 24 08:51:41.839878 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 473/920] 10.222.0.43 () {60 vars in 1258 bytes} [Fri Jun 24 08:51:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-107141842 => generated 0 bytes in 1034 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 08:51:43.569961 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-607ba872-ae9d-4539-8e1a-2b415640c955 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:43.570437 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-607ba872-ae9d-4539-8e1a-2b415640c955 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:43.577105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-607ba872-ae9d-4539-8e1a-2b415640c955 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:43.577555 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-607ba872-ae9d-4539-8e1a-2b415640c955 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:43.578306 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-607ba872-ae9d-4539-8e1a-2b415640c955 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:43.578735 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-607ba872-ae9d-4539-8e1a-2b415640c955 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:43.591653 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-607ba872-ae9d-4539-8e1a-2b415640c955 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] HTTP exception thrown: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-607ba872-ae9d-4539-8e1a-2b415640c955 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Request method failure captured: Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 HTTP/1.1 Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXjISBaZPnLTRFWfDFBrNoJb_9l8PMROGS9TZHCKbXDNj_v5GPbS_LWzfSeyv8QrRiiJ2p0EhwSb565cLn9CUiAAw9FDInOycXWZZ7kByah1En8fBZRCCnz_I_mA9HYiRd0eYq-Z9liDIEUACwUbJN36719ofSomjnY6gjuP30-gqB8 Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 150883a8e55c459a9f41fc48f8f81b0c Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:51:43.593180 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:51:43.594786 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_150883a8e55c459a9f41fc48f8f81b0c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:51:43.594786 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:43.594786 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 150883a8e55c459a9f41fc48f8f81b0c Jun 24 08:51:43.594786 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:43.594786 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeShelveTestJSON-779659428-project Jun 24 08:51:43.594786 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:51:43.594786 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:51:43.594786 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 12f0ce0a293f4114a90098985e5f21ee Jun 24 08:51:43.594786 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeShelveTestJSON-779659428-project Jun 24 08:51:43.594786 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:51:43.594786 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:43.594786 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': '9e8f47c2-c495-4707-8867-99604c4a1e73'} Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:51:43.595703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:43.597636 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:43.599127 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-607ba872-ae9d-4539-8e1a-2b415640c955 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Returning 404 to user: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:51:43.599127 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-607ba872-ae9d-4539-8e1a-2b415640c955 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 404 len: 111 microversion: 2.20 time: 0.028565 Jun 24 08:51:43.599127 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 448/921] 10.222.0.43 () {60 vars in 1279 bytes} [Fri Jun 24 08:51:43 2022] DELETE /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:51:43.603605 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d09f44fb-86cf-4b52-872c-6b842965cf4e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:43.604330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d09f44fb-86cf-4b52-872c-6b842965cf4e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 9e8f47c2-c495-4707-8867-99604c4a1e73] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:43.610925 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d09f44fb-86cf-4b52-872c-6b842965cf4e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:43.611402 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d09f44fb-86cf-4b52-872c-6b842965cf4e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:43.612207 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d09f44fb-86cf-4b52-872c-6b842965cf4e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:43.613236 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d09f44fb-86cf-4b52-872c-6b842965cf4e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:43.625910 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-d09f44fb-86cf-4b52-872c-6b842965cf4e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] HTTP exception thrown: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d09f44fb-86cf-4b52-872c-6b842965cf4e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Request method failure captured: Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 HTTP/1.1 Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXjISBaZPnLTRFWfDFBrNoJb_9l8PMROGS9TZHCKbXDNj_v5GPbS_LWzfSeyv8QrRiiJ2p0EhwSb565cLn9CUiAAw9FDInOycXWZZ7kByah1En8fBZRCCnz_I_mA9HYiRd0eYq-Z9liDIEUACwUbJN36719ofSomjnY6gjuP30-gqB8 Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 150883a8e55c459a9f41fc48f8f81b0c Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:51:43.627530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:51:43.629104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_150883a8e55c459a9f41fc48f8f81b0c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:51:43.629104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:43.629104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 150883a8e55c459a9f41fc48f8f81b0c Jun 24 08:51:43.629104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:43.629104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeShelveTestJSON-779659428-project Jun 24 08:51:43.629104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:51:43.629104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:51:43.629104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 12f0ce0a293f4114a90098985e5f21ee Jun 24 08:51:43.629104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeShelveTestJSON-779659428-project Jun 24 08:51:43.629104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:51:43.629104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:43.629104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '9e8f47c2-c495-4707-8867-99604c4a1e73'} Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:51:43.630016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. Jun 24 08:51:43.631489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:43.632900 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d09f44fb-86cf-4b52-872c-6b842965cf4e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Returning 404 to user: Instance 9e8f47c2-c495-4707-8867-99604c4a1e73 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:51:43.632900 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d09f44fb-86cf-4b52-872c-6b842965cf4e tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73" status: 404 len: 111 microversion: 2.20 time: 0.029269 Jun 24 08:51:43.632900 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 474/922] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:43 2022] GET /compute/v2.1/servers/9e8f47c2-c495-4707-8867-99604c4a1e73 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 24 08:51:44.759030 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-380c4b71-c460-4e4d-b413-28aa78f2e369 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:44.759581 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-380c4b71-c460-4e4d-b413-28aa78f2e369 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:44.765914 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-380c4b71-c460-4e4d-b413-28aa78f2e369 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:44.766360 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-380c4b71-c460-4e4d-b413-28aa78f2e369 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:44.767109 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-380c4b71-c460-4e4d-b413-28aa78f2e369 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:44.767571 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-380c4b71-c460-4e4d-b413-28aa78f2e369 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:44.780519 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-380c4b71-c460-4e4d-b413-28aa78f2e369 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] HTTP exception thrown: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-380c4b71-c460-4e4d-b413-28aa78f2e369 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Request method failure captured: Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: DELETE /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 HTTP/1.1 Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXjISBaZPnLTRFWfDFBrNoJb_9l8PMROGS9TZHCKbXDNj_v5GPbS_LWzfSeyv8QrRiiJ2p0EhwSb565cLn9CUiAAw9FDInOycXWZZ7kByah1En8fBZRCCnz_I_mA9HYiRd0eYq-Z9liDIEUACwUbJN36719ofSomjnY6gjuP30-gqB8 Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 150883a8e55c459a9f41fc48f8f81b0c Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:51:44.782041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:51:44.783645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_150883a8e55c459a9f41fc48f8f81b0c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:51:44.783645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:44.783645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 150883a8e55c459a9f41fc48f8f81b0c Jun 24 08:51:44.783645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:44.783645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeShelveTestJSON-779659428-project Jun 24 08:51:44.783645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:51:44.783645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:51:44.783645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 12f0ce0a293f4114a90098985e5f21ee Jun 24 08:51:44.783645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeShelveTestJSON-779659428-project Jun 24 08:51:44.783645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:51:44.783645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:51:44.783645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': '8f6b0e38-4e81-4595-9acd-ec8335bb5db5'} Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:51:44.784393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:51:44.785639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:51:44.786841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-380c4b71-c460-4e4d-b413-28aa78f2e369 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Returning 404 to user: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:51:44.786841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-380c4b71-c460-4e4d-b413-28aa78f2e369 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 404 len: 111 microversion: 2.20 time: 0.028276 Jun 24 08:51:44.786841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 449/923] 10.222.0.43 () {60 vars in 1279 bytes} [Fri Jun 24 08:51:44 2022] DELETE /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:51:44.791650 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-687633c3-4b7d-4389-89db-f6d2578fb525 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:44.792267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-687633c3-4b7d-4389-89db-f6d2578fb525 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] [instance: 8f6b0e38-4e81-4595-9acd-ec8335bb5db5] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:44.798222 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-687633c3-4b7d-4389-89db-f6d2578fb525 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:44.798671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-687633c3-4b7d-4389-89db-f6d2578fb525 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:44.799458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-687633c3-4b7d-4389-89db-f6d2578fb525 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:44.800637 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-687633c3-4b7d-4389-89db-f6d2578fb525 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:44.813682 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-687633c3-4b7d-4389-89db-f6d2578fb525 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] HTTP exception thrown: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-687633c3-4b7d-4389-89db-f6d2578fb525 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Request method failure captured: Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 HTTP/1.1 Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXjISBaZPnLTRFWfDFBrNoJb_9l8PMROGS9TZHCKbXDNj_v5GPbS_LWzfSeyv8QrRiiJ2p0EhwSb565cLn9CUiAAw9FDInOycXWZZ7kByah1En8fBZRCCnz_I_mA9HYiRd0eYq-Z9liDIEUACwUbJN36719ofSomjnY6gjuP30-gqB8 Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 150883a8e55c459a9f41fc48f8f81b0c Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:51:44.815164 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:51:44.817460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_150883a8e55c459a9f41fc48f8f81b0c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/150883a8e55c459a9f41fc48f8f81b0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:51:44.817460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:44.817460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 150883a8e55c459a9f41fc48f8f81b0c Jun 24 08:51:44.817460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-779659428 Jun 24 08:51:44.817460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeShelveTestJSON-779659428-project Jun 24 08:51:44.817460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:51:44.817460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:51:44.817460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 12f0ce0a293f4114a90098985e5f21ee Jun 24 08:51:44.817460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeShelveTestJSON-779659428-project Jun 24 08:51:44.817460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:51:44.817460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:51:44.817460 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '8f6b0e38-4e81-4595-9acd-ec8335bb5db5'} Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:51:44.818268 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. Jun 24 08:51:44.819525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:51:44.820615 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-687633c3-4b7d-4389-89db-f6d2578fb525 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] Returning 404 to user: Instance 8f6b0e38-4e81-4595-9acd-ec8335bb5db5 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:51:44.820615 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-687633c3-4b7d-4389-89db-f6d2578fb525 tempest-AttachVolumeShelveTestJSON-779659428 tempest-AttachVolumeShelveTestJSON-779659428-project] 10.222.0.43 "GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5" status: 404 len: 111 microversion: 2.20 time: 0.029395 Jun 24 08:51:44.820615 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 475/924] 10.222.0.43 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:44 2022] GET /compute/v2.1/servers/8f6b0e38-4e81-4595-9acd-ec8335bb5db5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:51:52.876347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ebc077b9-0e81-41dd-a062-471d60401735 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Action: 'create', calling method: .version_select at 0x7fb75c805550>, body: {"keypair": {"name": "tempest-keypair-362760192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDCICKEojniDltsv5ukd9AuKcyPUVQMCST3cfymVVAQrIQZ0GcDtwk2VANlgAoZNcHvvuSyJtfQObp1mDl9Wzxpsqu6O72Nnsi8MeydqK4E0Jo0+petAzdSWDEFXMGWOg=="}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:52.891000 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-ebc077b9-0e81-41dd-a062-471d60401735 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for project 0ae612a1712a404681313b8758eb4f2d. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:51:52.895696 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-ebc077b9-0e81-41dd-a062-471d60401735 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for user 8d3b1f091b4644d3b15b66eee01271c6 and project 0ae612a1712a404681313b8758eb4f2d. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:51:52.918990 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ebc077b9-0e81-41dd-a062-471d60401735 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.163286 Jun 24 08:51:52.919891 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 450/925] 10.222.0.43 () {60 vars in 1158 bytes} [Fri Jun 24 08:51:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:54.166094 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-838015416", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "088f6f07-6d3f-4c03-8832-f8bccdce4c55"}], "security_groups": [{"name": "tempest-securitygroup--243443726"}], "key_name": "tempest-keypair-362760192", "user_data": "}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:54.271858 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] validate_networks() for [('088f6f07-6d3f-4c03-8832-f8bccdce4c55', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:51:54.660670 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:51:54.661959 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:51:54.663055 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:51:54.663575 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:51:54.664206 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:51:54.674649 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:54.676047 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:54.677045 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:54.677699 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:54.696465 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for project 0ae612a1712a404681313b8758eb4f2d. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:51:54.700685 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for user 8d3b1f091b4644d3b15b66eee01271c6 and project 0ae612a1712a404681313b8758eb4f2d. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:51:54.714593 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:51:54.716908 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:51:54.773623 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ff90d5d5-f6c8-408e-8ad5-5e9807cb3fa0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.611810 Jun 24 08:51:54.774580 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 476/926] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:51:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:51:54.782129 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=24 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:54.787595 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d6f3b339-94d6-4f73-83c8-f222436a142f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:54.788542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d6f3b339-94d6-4f73-83c8-f222436a142f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:54.882889 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d6f3b339-94d6-4f73-83c8-f222436a142f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:54.890058 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d6f3b339-94d6-4f73-83c8-f222436a142f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 200 len: 1240 microversion: 2.1 time: 0.109122 Jun 24 08:51:54.891193 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 451/927] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:54 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:55.906967 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9186b720-ec9c-4baa-b8ae-4140d9af932b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:55.908489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9186b720-ec9c-4baa-b8ae-4140d9af932b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:55.916850 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9186b720-ec9c-4baa-b8ae-4140d9af932b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:55.917218 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9186b720-ec9c-4baa-b8ae-4140d9af932b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:55.918128 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9186b720-ec9c-4baa-b8ae-4140d9af932b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:55.918569 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9186b720-ec9c-4baa-b8ae-4140d9af932b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:55.997998 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9186b720-ec9c-4baa-b8ae-4140d9af932b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:56.007665 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9186b720-ec9c-4baa-b8ae-4140d9af932b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 200 len: 1300 microversion: 2.1 time: 0.104504 Jun 24 08:51:56.008798 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 477/928] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:55 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:57.025710 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4d5ec5ea-3e1c-4290-8ce2-ee6c5a0eae59 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:57.026338 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4d5ec5ea-3e1c-4290-8ce2-ee6c5a0eae59 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:57.033090 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d5ec5ea-3e1c-4290-8ce2-ee6c5a0eae59 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:57.033539 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d5ec5ea-3e1c-4290-8ce2-ee6c5a0eae59 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:57.034814 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d5ec5ea-3e1c-4290-8ce2-ee6c5a0eae59 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:57.035274 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4d5ec5ea-3e1c-4290-8ce2-ee6c5a0eae59 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:57.169501 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4d5ec5ea-3e1c-4290-8ce2-ee6c5a0eae59 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:57.182661 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4d5ec5ea-3e1c-4290-8ce2-ee6c5a0eae59 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 200 len: 1365 microversion: 2.1 time: 0.160877 Jun 24 08:51:57.183249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 452/929] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:57 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:57.617082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-ad437d7e-13d8-4f3e-9a32-21f910de2958 req-ec8f8e04-7e3f-4459-baf4-9dbb7f57b645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7560a2-34d6-476c-ad87-c5b0d2279653", "tag": "b5ba33be-59e9-4a60-8fca-a72c23291a91"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:57.628854 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-ad437d7e-13d8-4f3e-9a32-21f910de2958 req-ec8f8e04-7e3f-4459-baf4-9dbb7f57b645 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:57.629572 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-ad437d7e-13d8-4f3e-9a32-21f910de2958 req-ec8f8e04-7e3f-4459-baf4-9dbb7f57b645 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:57.640993 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-ad437d7e-13d8-4f3e-9a32-21f910de2958 req-ec8f8e04-7e3f-4459-baf4-9dbb7f57b645 service nova] Creating event network-changed:b5ba33be-59e9-4a60-8fca-a72c23291a91 for instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 on hv-cinder-84517 Jun 24 08:51:57.646308 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-ad437d7e-13d8-4f3e-9a32-21f910de2958 req-ec8f8e04-7e3f-4459-baf4-9dbb7f57b645 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032879 Jun 24 08:51:57.647108 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 478/930] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:58.202174 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-709d37c2-029d-4248-bf30-80b4ee5c7ca2 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:58.203119 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-709d37c2-029d-4248-bf30-80b4ee5c7ca2 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:58.212593 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-709d37c2-029d-4248-bf30-80b4ee5c7ca2 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:58.213263 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-709d37c2-029d-4248-bf30-80b4ee5c7ca2 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:58.214420 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-709d37c2-029d-4248-bf30-80b4ee5c7ca2 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:58.215092 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-709d37c2-029d-4248-bf30-80b4ee5c7ca2 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:58.342007 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-709d37c2-029d-4248-bf30-80b4ee5c7ca2 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:58.349308 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-709d37c2-029d-4248-bf30-80b4ee5c7ca2 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 200 len: 1365 microversion: 2.1 time: 0.153269 Jun 24 08:51:58.349873 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 453/931] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:58 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:59.366668 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-691cba3b-e79b-46b8-90ea-a94047c774d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:59.367395 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-691cba3b-e79b-46b8-90ea-a94047c774d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:59.373554 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-691cba3b-e79b-46b8-90ea-a94047c774d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:59.373994 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-691cba3b-e79b-46b8-90ea-a94047c774d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:59.374744 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-691cba3b-e79b-46b8-90ea-a94047c774d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:59.375192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-691cba3b-e79b-46b8-90ea-a94047c774d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:59.505379 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-691cba3b-e79b-46b8-90ea-a94047c774d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:59.512755 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-691cba3b-e79b-46b8-90ea-a94047c774d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 200 len: 1365 microversion: 2.1 time: 0.150328 Jun 24 08:51:59.513313 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 479/932] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:59 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:00.529486 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c7ecbed8-4f74-4bf4-b82a-1dd837ffc06d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:00.530105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c7ecbed8-4f74-4bf4-b82a-1dd837ffc06d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:00.536477 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7ecbed8-4f74-4bf4-b82a-1dd837ffc06d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:00.536927 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7ecbed8-4f74-4bf4-b82a-1dd837ffc06d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:00.537696 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7ecbed8-4f74-4bf4-b82a-1dd837ffc06d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:00.538130 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c7ecbed8-4f74-4bf4-b82a-1dd837ffc06d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:00.665932 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c7ecbed8-4f74-4bf4-b82a-1dd837ffc06d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:00.673411 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c7ecbed8-4f74-4bf4-b82a-1dd837ffc06d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 200 len: 1365 microversion: 2.1 time: 0.147799 Jun 24 08:52:00.673977 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 454/933] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:00 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:01.691090 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ce38f75c-aa53-4ba4-a2df-10fef8221f27 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:01.691639 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ce38f75c-aa53-4ba4-a2df-10fef8221f27 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:01.697659 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ce38f75c-aa53-4ba4-a2df-10fef8221f27 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:01.698108 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ce38f75c-aa53-4ba4-a2df-10fef8221f27 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:01.698864 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ce38f75c-aa53-4ba4-a2df-10fef8221f27 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:01.699328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ce38f75c-aa53-4ba4-a2df-10fef8221f27 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:01.829029 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ce38f75c-aa53-4ba4-a2df-10fef8221f27 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:01.836870 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ce38f75c-aa53-4ba4-a2df-10fef8221f27 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 200 len: 1365 microversion: 2.1 time: 0.149759 Jun 24 08:52:01.837625 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 480/934] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:01 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:02.852892 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dba5d557-83a4-4d74-987c-3e5148eb2fff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:02.853508 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dba5d557-83a4-4d74-987c-3e5148eb2fff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:02.860025 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dba5d557-83a4-4d74-987c-3e5148eb2fff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:02.860479 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dba5d557-83a4-4d74-987c-3e5148eb2fff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:02.861241 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dba5d557-83a4-4d74-987c-3e5148eb2fff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:02.861676 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dba5d557-83a4-4d74-987c-3e5148eb2fff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:02.993065 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-dba5d557-83a4-4d74-987c-3e5148eb2fff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:03.000447 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dba5d557-83a4-4d74-987c-3e5148eb2fff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 200 len: 1365 microversion: 2.1 time: 0.151472 Jun 24 08:52:03.001014 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 455/935] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:02 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:03.222642 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-950cdc76-2fee-46d4-b6e8-9f67f66e5582 req-f6a37932-f888-4682-bede-874e3bf6a682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7560a2-34d6-476c-ad87-c5b0d2279653", "name": "network-vif-plugged", "status": "completed", "tag": "b5ba33be-59e9-4a60-8fca-a72c23291a91"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:52:03.231197 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-950cdc76-2fee-46d4-b6e8-9f67f66e5582 req-f6a37932-f888-4682-bede-874e3bf6a682 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:03.231808 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-950cdc76-2fee-46d4-b6e8-9f67f66e5582 req-f6a37932-f888-4682-bede-874e3bf6a682 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:03.243920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-950cdc76-2fee-46d4-b6e8-9f67f66e5582 req-f6a37932-f888-4682-bede-874e3bf6a682 service nova] Creating event network-vif-plugged:b5ba33be-59e9-4a60-8fca-a72c23291a91 for instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 on hv-cinder-84517 Jun 24 08:52:03.248833 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-950cdc76-2fee-46d4-b6e8-9f67f66e5582 req-f6a37932-f888-4682-bede-874e3bf6a682 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030478 Jun 24 08:52:03.249422 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 481/936] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:04.017794 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cada4171-7ab8-4eb5-9657-1df1b7f964a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:04.018403 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cada4171-7ab8-4eb5-9657-1df1b7f964a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:04.025413 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cada4171-7ab8-4eb5-9657-1df1b7f964a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:04.025865 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cada4171-7ab8-4eb5-9657-1df1b7f964a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:04.026622 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cada4171-7ab8-4eb5-9657-1df1b7f964a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:04.027058 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cada4171-7ab8-4eb5-9657-1df1b7f964a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:04.153350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-cada4171-7ab8-4eb5-9657-1df1b7f964a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:04.160639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cada4171-7ab8-4eb5-9657-1df1b7f964a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 200 len: 1365 microversion: 2.1 time: 0.146754 Jun 24 08:52:04.161200 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 456/937] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:04 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:05.178520 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5ff8b11f-d5e5-4689-94e2-b830146d0dc0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:05.179351 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5ff8b11f-d5e5-4689-94e2-b830146d0dc0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:05.181610 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:05.182357 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=6 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:05.188501 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5ff8b11f-d5e5-4689-94e2-b830146d0dc0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:05.188943 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5ff8b11f-d5e5-4689-94e2-b830146d0dc0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:05.189895 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5ff8b11f-d5e5-4689-94e2-b830146d0dc0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:05.190395 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5ff8b11f-d5e5-4689-94e2-b830146d0dc0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:05.323616 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5ff8b11f-d5e5-4689-94e2-b830146d0dc0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:05.331751 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5ff8b11f-d5e5-4689-94e2-b830146d0dc0 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 200 len: 1555 microversion: 2.1 time: 0.157332 Jun 24 08:52:05.332315 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 482/938] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:05 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:05.347904 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-07b8eef3-14a3-4f35-9caf-49754f55739c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:05.348412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-07b8eef3-14a3-4f35-9caf-49754f55739c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:05.350235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:05.356179 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07b8eef3-14a3-4f35-9caf-49754f55739c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:05.356635 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07b8eef3-14a3-4f35-9caf-49754f55739c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:05.357404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07b8eef3-14a3-4f35-9caf-49754f55739c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:05.357842 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-07b8eef3-14a3-4f35-9caf-49754f55739c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:05.434917 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-07b8eef3-14a3-4f35-9caf-49754f55739c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090814 Jun 24 08:52:05.435548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 457/939] 10.222.0.43 () {58 vars in 1274 bytes} [Fri Jun 24 08:52:05 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:06.584921 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-feb55141-fb53-4ec3-82c0-235bf5d18d7e req-658887d5-d71f-4c77-9daf-2cbf3eee0f98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7560a2-34d6-476c-ad87-c5b0d2279653", "tag": "b5ba33be-59e9-4a60-8fca-a72c23291a91"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:52:06.592905 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-feb55141-fb53-4ec3-82c0-235bf5d18d7e req-658887d5-d71f-4c77-9daf-2cbf3eee0f98 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:06.593345 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-feb55141-fb53-4ec3-82c0-235bf5d18d7e req-658887d5-d71f-4c77-9daf-2cbf3eee0f98 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:06.604778 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-feb55141-fb53-4ec3-82c0-235bf5d18d7e req-658887d5-d71f-4c77-9daf-2cbf3eee0f98 service nova] Creating event network-changed:b5ba33be-59e9-4a60-8fca-a72c23291a91 for instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 on hv-cinder-84517 Jun 24 08:52:06.609866 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-feb55141-fb53-4ec3-82c0-235bf5d18d7e req-658887d5-d71f-4c77-9daf-2cbf3eee0f98 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029113 Jun 24 08:52:06.610729 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 483/940] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:12.651970 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-daa478ee-3452-4be8-b718-0103bf568dc8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:12.652519 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-daa478ee-3452-4be8-b718-0103bf568dc8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:12.654928 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:12.661042 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-daa478ee-3452-4be8-b718-0103bf568dc8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:12.661488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-daa478ee-3452-4be8-b718-0103bf568dc8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:12.662271 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-daa478ee-3452-4be8-b718-0103bf568dc8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:12.662700 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-daa478ee-3452-4be8-b718-0103bf568dc8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:12.741657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-daa478ee-3452-4be8-b718-0103bf568dc8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lazy-loading 'services' on Instance uuid 77cd8982-eb26-429b-ba63-c8f02412f7c3 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:52:12.813503 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-daa478ee-3452-4be8-b718-0103bf568dc8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "DELETE /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/os-volume_attachments/735c6ca9-2710-48aa-a089-522e3d0ef0bb" status: 202 len: 0 microversion: 2.1 time: 0.165248 Jun 24 08:52:12.814098 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 458/941] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Jun 24 08:52:12 2022] DELETE /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/os-volume_attachments/735c6ca9-2710-48aa-a089-522e3d0ef0bb => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:52:13.923066 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-417da405-3e8d-4065-a5c2-668c175f6b29 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:52:13.925946 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:13.931493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-417da405-3e8d-4065-a5c2-668c175f6b29 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:13.931935 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-417da405-3e8d-4065-a5c2-668c175f6b29 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:13.935915 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:13.957584 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-417da405-3e8d-4065-a5c2-668c175f6b29 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Going to try to stop instance {{(pid=124379) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 08:52:14.000421 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-417da405-3e8d-4065-a5c2-668c175f6b29 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "POST /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/action" status: 202 len: 0 microversion: 2.1 time: 0.081169 Jun 24 08:52:14.001026 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 484/942] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Jun 24 08:52:13 2022] POST /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:52:14.010691 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d822f853-b2a8-4b3b-9260-5f61525046f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:14.011503 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d822f853-b2a8-4b3b-9260-5f61525046f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:14.018202 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d822f853-b2a8-4b3b-9260-5f61525046f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:14.018754 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d822f853-b2a8-4b3b-9260-5f61525046f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:14.019553 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d822f853-b2a8-4b3b-9260-5f61525046f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:14.019989 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d822f853-b2a8-4b3b-9260-5f61525046f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:14.148339 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d822f853-b2a8-4b3b-9260-5f61525046f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:14.155693 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d822f853-b2a8-4b3b-9260-5f61525046f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1677 microversion: 2.1 time: 0.149701 Jun 24 08:52:14.156239 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 459/943] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:14 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:15.173768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-84897aa2-cee9-4bd9-bfb1-e9b34042d85c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:15.174495 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-84897aa2-cee9-4bd9-bfb1-e9b34042d85c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:15.181302 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84897aa2-cee9-4bd9-bfb1-e9b34042d85c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:15.181422 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84897aa2-cee9-4bd9-bfb1-e9b34042d85c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:15.182106 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84897aa2-cee9-4bd9-bfb1-e9b34042d85c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:15.182531 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-84897aa2-cee9-4bd9-bfb1-e9b34042d85c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:15.309587 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-84897aa2-cee9-4bd9-bfb1-e9b34042d85c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:15.317508 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-84897aa2-cee9-4bd9-bfb1-e9b34042d85c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1677 microversion: 2.1 time: 0.147968 Jun 24 08:52:15.318061 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 485/944] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:15 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:16.335375 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-eeef4c05-1f12-4505-b2ce-2c8e2cccadea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:16.335939 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-eeef4c05-1f12-4505-b2ce-2c8e2cccadea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:16.342338 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eeef4c05-1f12-4505-b2ce-2c8e2cccadea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:16.342790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eeef4c05-1f12-4505-b2ce-2c8e2cccadea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:16.343584 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eeef4c05-1f12-4505-b2ce-2c8e2cccadea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:16.344027 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-eeef4c05-1f12-4505-b2ce-2c8e2cccadea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:16.472219 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-eeef4c05-1f12-4505-b2ce-2c8e2cccadea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:16.479553 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-eeef4c05-1f12-4505-b2ce-2c8e2cccadea tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1677 microversion: 2.1 time: 0.148676 Jun 24 08:52:16.480113 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 460/945] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:16 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:17.496792 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1b16ab62-b593-4ad4-861c-9c9252973d6a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:17.497361 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1b16ab62-b593-4ad4-861c-9c9252973d6a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:17.503347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b16ab62-b593-4ad4-861c-9c9252973d6a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:17.503790 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b16ab62-b593-4ad4-861c-9c9252973d6a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:17.504552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b16ab62-b593-4ad4-861c-9c9252973d6a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:17.504982 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1b16ab62-b593-4ad4-861c-9c9252973d6a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:17.637122 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1b16ab62-b593-4ad4-861c-9c9252973d6a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:17.645356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1b16ab62-b593-4ad4-861c-9c9252973d6a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1677 microversion: 2.1 time: 0.152214 Jun 24 08:52:17.645616 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 486/946] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:17 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:18.663048 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-481ae6c0-227a-4421-b6a3-f7309e48b3a4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:18.663687 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-481ae6c0-227a-4421-b6a3-f7309e48b3a4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:18.670080 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-481ae6c0-227a-4421-b6a3-f7309e48b3a4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:18.670522 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-481ae6c0-227a-4421-b6a3-f7309e48b3a4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:18.671292 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-481ae6c0-227a-4421-b6a3-f7309e48b3a4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:18.671725 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-481ae6c0-227a-4421-b6a3-f7309e48b3a4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:18.797848 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-481ae6c0-227a-4421-b6a3-f7309e48b3a4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:18.806007 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-481ae6c0-227a-4421-b6a3-f7309e48b3a4 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1677 microversion: 2.1 time: 0.146865 Jun 24 08:52:18.806559 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 461/947] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:18 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:19.822840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-13d465a2-2a01-487e-8750-531c3f6962de tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:19.823473 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-13d465a2-2a01-487e-8750-531c3f6962de tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:19.829517 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13d465a2-2a01-487e-8750-531c3f6962de tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:19.829963 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13d465a2-2a01-487e-8750-531c3f6962de tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:19.830721 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13d465a2-2a01-487e-8750-531c3f6962de tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:19.831160 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-13d465a2-2a01-487e-8750-531c3f6962de tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:19.955041 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-13d465a2-2a01-487e-8750-531c3f6962de tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:19.962895 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-13d465a2-2a01-487e-8750-531c3f6962de tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1677 microversion: 2.1 time: 0.143918 Jun 24 08:52:19.963486 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 487/948] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:19 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1677 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:20.979646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d58f0a22-caae-4e0f-862c-c8bd17e97f0c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:20.980253 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d58f0a22-caae-4e0f-862c-c8bd17e97f0c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:20.986576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d58f0a22-caae-4e0f-862c-c8bd17e97f0c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:20.987026 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d58f0a22-caae-4e0f-862c-c8bd17e97f0c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:20.988403 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d58f0a22-caae-4e0f-862c-c8bd17e97f0c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:20.988837 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d58f0a22-caae-4e0f-862c-c8bd17e97f0c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:21.116745 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d58f0a22-caae-4e0f-862c-c8bd17e97f0c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:21.124106 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d58f0a22-caae-4e0f-862c-c8bd17e97f0c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1677 microversion: 2.1 time: 0.148341 Jun 24 08:52:21.124674 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 462/949] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:20 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:22.141225 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e278e404-8ad6-4169-aebb-c2f868bcee46 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:22.141864 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e278e404-8ad6-4169-aebb-c2f868bcee46 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:22.147848 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e278e404-8ad6-4169-aebb-c2f868bcee46 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:22.148296 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e278e404-8ad6-4169-aebb-c2f868bcee46 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:22.149051 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e278e404-8ad6-4169-aebb-c2f868bcee46 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:22.149485 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e278e404-8ad6-4169-aebb-c2f868bcee46 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:22.278337 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e278e404-8ad6-4169-aebb-c2f868bcee46 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:22.285800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e278e404-8ad6-4169-aebb-c2f868bcee46 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1677 microversion: 2.1 time: 0.148469 Jun 24 08:52:22.286366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 488/950] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:22 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:23.303320 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-581da07b-9daa-4eff-9652-62f62f8846eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:23.303942 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-581da07b-9daa-4eff-9652-62f62f8846eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:23.310540 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-581da07b-9daa-4eff-9652-62f62f8846eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:23.310995 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-581da07b-9daa-4eff-9652-62f62f8846eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:23.311795 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-581da07b-9daa-4eff-9652-62f62f8846eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:23.312235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-581da07b-9daa-4eff-9652-62f62f8846eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:23.435702 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-581da07b-9daa-4eff-9652-62f62f8846eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:23.443551 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-581da07b-9daa-4eff-9652-62f62f8846eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1677 microversion: 2.1 time: 0.144513 Jun 24 08:52:23.444117 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 463/951] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:23 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:24.461182 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a731e192-15d5-462b-8642-20ba6bb4f261 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:24.461740 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a731e192-15d5-462b-8642-20ba6bb4f261 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:24.467626 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a731e192-15d5-462b-8642-20ba6bb4f261 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:24.468070 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a731e192-15d5-462b-8642-20ba6bb4f261 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:24.468815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a731e192-15d5-462b-8642-20ba6bb4f261 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:24.469244 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a731e192-15d5-462b-8642-20ba6bb4f261 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:24.602627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a731e192-15d5-462b-8642-20ba6bb4f261 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:24.610035 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a731e192-15d5-462b-8642-20ba6bb4f261 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1654 microversion: 2.1 time: 0.152822 Jun 24 08:52:24.610607 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 489/952] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:24 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:24.626267 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cc2935af-fac3-45b6-bd6b-448cf480920a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:52:24.632847 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cc2935af-fac3-45b6-bd6b-448cf480920a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:24.633298 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cc2935af-fac3-45b6-bd6b-448cf480920a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:24.655257 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cc2935af-fac3-45b6-bd6b-448cf480920a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Going to try to start instance {{(pid=124380) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 08:52:24.698318 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cc2935af-fac3-45b6-bd6b-448cf480920a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "POST /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/action" status: 202 len: 0 microversion: 2.1 time: 0.075724 Jun 24 08:52:24.698919 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 464/953] 10.222.0.43 () {60 vars in 1277 bytes} [Fri Jun 24 08:52:24 2022] POST /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:52:24.707893 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e4086572-e038-46cf-97b1-6a61737e5d75 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:24.708505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e4086572-e038-46cf-97b1-6a61737e5d75 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:24.714828 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e4086572-e038-46cf-97b1-6a61737e5d75 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:24.715293 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e4086572-e038-46cf-97b1-6a61737e5d75 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:24.716067 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e4086572-e038-46cf-97b1-6a61737e5d75 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:24.716502 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e4086572-e038-46cf-97b1-6a61737e5d75 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:24.845243 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e4086572-e038-46cf-97b1-6a61737e5d75 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:24.853233 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e4086572-e038-46cf-97b1-6a61737e5d75 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1663 microversion: 2.1 time: 0.149718 Jun 24 08:52:24.853837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 490/954] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:24 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:25.871228 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6f5df2cc-8995-4f49-a2f7-a987055d4d56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:25.871965 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6f5df2cc-8995-4f49-a2f7-a987055d4d56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:25.878697 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f5df2cc-8995-4f49-a2f7-a987055d4d56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:25.879150 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f5df2cc-8995-4f49-a2f7-a987055d4d56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:25.879933 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f5df2cc-8995-4f49-a2f7-a987055d4d56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:25.880366 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6f5df2cc-8995-4f49-a2f7-a987055d4d56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:25.882941 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:26.016269 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6f5df2cc-8995-4f49-a2f7-a987055d4d56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:26.023651 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6f5df2cc-8995-4f49-a2f7-a987055d4d56 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1663 microversion: 2.1 time: 0.157079 Jun 24 08:52:26.024215 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 465/955] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:25 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:52:27.041578 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9fead87a-31dc-4335-88f7-cb8efde42f4f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:27.042191 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9fead87a-31dc-4335-88f7-cb8efde42f4f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:27.048314 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9fead87a-31dc-4335-88f7-cb8efde42f4f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:27.048768 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9fead87a-31dc-4335-88f7-cb8efde42f4f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:27.049528 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9fead87a-31dc-4335-88f7-cb8efde42f4f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:27.049965 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9fead87a-31dc-4335-88f7-cb8efde42f4f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:27.174309 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9fead87a-31dc-4335-88f7-cb8efde42f4f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:52:27.182079 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9fead87a-31dc-4335-88f7-cb8efde42f4f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1667 microversion: 2.1 time: 0.144403 Jun 24 08:52:27.182655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 491/956] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:52:27 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1667 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:02.533871 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c0c2fca6-6b04-462a-b2a6-b7c8d78a1c0b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:02.534405 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c0c2fca6-6b04-462a-b2a6-b7c8d78a1c0b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:02.536518 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=15 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:02.537216 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=15 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:02.537663 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=5 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:02.538147 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:02.543392 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c0c2fca6-6b04-462a-b2a6-b7c8d78a1c0b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:02.543904 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c0c2fca6-6b04-462a-b2a6-b7c8d78a1c0b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:02.544917 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c0c2fca6-6b04-462a-b2a6-b7c8d78a1c0b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:02.545582 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c0c2fca6-6b04-462a-b2a6-b7c8d78a1c0b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:02.574284 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c0c2fca6-6b04-462a-b2a6-b7c8d78a1c0b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:53:02.606705 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-315bb13d-767d-42ad-ab0f-2512eb53625e req-2306adb3-a656-4505-b1a2-cfe118e90158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f39324f-89be-4fb8-af15-a44da05f0f48", "tag": "3e005c82-378b-4b80-96f1-f4005830fe97"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:02.616674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-315bb13d-767d-42ad-ab0f-2512eb53625e req-2306adb3-a656-4505-b1a2-cfe118e90158 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:02.617240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-315bb13d-767d-42ad-ab0f-2512eb53625e req-2306adb3-a656-4505-b1a2-cfe118e90158 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:02.628186 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-315bb13d-767d-42ad-ab0f-2512eb53625e req-2306adb3-a656-4505-b1a2-cfe118e90158 service nova] Creating event network-changed:3e005c82-378b-4b80-96f1-f4005830fe97 for instance 1f39324f-89be-4fb8-af15-a44da05f0f48 on hv-cinder-84517 Jun 24 08:53:02.634408 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-315bb13d-767d-42ad-ab0f-2512eb53625e req-2306adb3-a656-4505-b1a2-cfe118e90158 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101787 Jun 24 08:53:02.635259 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 492/957] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:02.653116 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c0c2fca6-6b04-462a-b2a6-b7c8d78a1c0b tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 204 len: 0 microversion: 2.1 time: 0.122955 Jun 24 08:53:02.656685 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 466/958] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:53:02 2022] DELETE /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:53:02.662360 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7f561627-72a8-4b05-8d45-b39695434e62 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:02.663059 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7f561627-72a8-4b05-8d45-b39695434e62 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:02.669249 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f561627-72a8-4b05-8d45-b39695434e62 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:02.669702 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f561627-72a8-4b05-8d45-b39695434e62 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:02.670454 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f561627-72a8-4b05-8d45-b39695434e62 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:02.670895 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7f561627-72a8-4b05-8d45-b39695434e62 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:02.808536 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7f561627-72a8-4b05-8d45-b39695434e62 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:02.816808 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7f561627-72a8-4b05-8d45-b39695434e62 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1577 microversion: 2.1 time: 0.158651 Jun 24 08:53:02.817381 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 493/959] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:02 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:03.834728 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-370fef1a-a6ab-4168-baac-4422d4275d76 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:03.835512 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-370fef1a-a6ab-4168-baac-4422d4275d76 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:03.842370 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-370fef1a-a6ab-4168-baac-4422d4275d76 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:03.842822 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-370fef1a-a6ab-4168-baac-4422d4275d76 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:03.843626 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-370fef1a-a6ab-4168-baac-4422d4275d76 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:03.844069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-370fef1a-a6ab-4168-baac-4422d4275d76 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:03.978404 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-370fef1a-a6ab-4168-baac-4422d4275d76 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:03.986233 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-370fef1a-a6ab-4168-baac-4422d4275d76 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1577 microversion: 2.1 time: 0.156434 Jun 24 08:53:03.986868 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 467/960] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:03 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:05.003680 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7b0e78ee-ca34-4feb-a90d-d9d70db07750 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:05.004298 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7b0e78ee-ca34-4feb-a90d-d9d70db07750 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:05.010551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7b0e78ee-ca34-4feb-a90d-d9d70db07750 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:05.011087 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7b0e78ee-ca34-4feb-a90d-d9d70db07750 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:05.011903 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7b0e78ee-ca34-4feb-a90d-d9d70db07750 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:05.012337 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7b0e78ee-ca34-4feb-a90d-d9d70db07750 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:05.141143 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7b0e78ee-ca34-4feb-a90d-d9d70db07750 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:05.151129 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7b0e78ee-ca34-4feb-a90d-d9d70db07750 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 200 len: 1458 microversion: 2.1 time: 0.152369 Jun 24 08:53:05.152109 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 494/961] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:04 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 1458 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:05.311103 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-9fad968a-c1b7-404c-8dbe-200b74092a08 req-1744a88c-f088-4378-a1ca-d47315df25d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f39324f-89be-4fb8-af15-a44da05f0f48", "name": "network-vif-deleted", "tag": "3e005c82-378b-4b80-96f1-f4005830fe97"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:05.319647 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-9fad968a-c1b7-404c-8dbe-200b74092a08 req-1744a88c-f088-4378-a1ca-d47315df25d3 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:05.320093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-9fad968a-c1b7-404c-8dbe-200b74092a08 req-1744a88c-f088-4378-a1ca-d47315df25d3 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:05.331346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-9fad968a-c1b7-404c-8dbe-200b74092a08 req-1744a88c-f088-4378-a1ca-d47315df25d3 service nova] Creating event network-vif-deleted:3e005c82-378b-4b80-96f1-f4005830fe97 for instance 1f39324f-89be-4fb8-af15-a44da05f0f48 on hv-cinder-84517 Jun 24 08:53:05.336035 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-9fad968a-c1b7-404c-8dbe-200b74092a08 req-1744a88c-f088-4378-a1ca-d47315df25d3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089728 Jun 24 08:53:05.336623 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 468/962] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:06.168277 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e0f97260-25b3-4814-a06e-0315973728b4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:06.168808 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e0f97260-25b3-4814-a06e-0315973728b4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 1f39324f-89be-4fb8-af15-a44da05f0f48] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:06.175678 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e0f97260-25b3-4814-a06e-0315973728b4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:06.176125 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e0f97260-25b3-4814-a06e-0315973728b4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:06.176892 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e0f97260-25b3-4814-a06e-0315973728b4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:06.177321 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e0f97260-25b3-4814-a06e-0315973728b4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:06.190657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-e0f97260-25b3-4814-a06e-0315973728b4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] HTTP exception thrown: Instance 1f39324f-89be-4fb8-af15-a44da05f0f48 could not be found. Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e0f97260-25b3-4814-a06e-0315973728b4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Request method failure captured: Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 HTTP/1.1 Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXlvcj740GAXS8rpxFHO7HajxPWrmwYlx3RSIokdv0haB_yxqHtwAjETWOIhVbbqRtRcvAEVLPxozLuxna8w1m4vBt-7lOfpH_NDmJC7yngKQO3Aw6fr_Dh3KrosQWmzqzDvLmNOh6xLnDUq6VXwhYma19B_7h5bh5qaV_rPKbKnoKM Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 891980c3542d4223a15461bb7c5dcff9 Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:53:06.192318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:53:06.194009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_891980c3542d4223a15461bb7c5dcff9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:53:06.194009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:53:06.194009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 891980c3542d4223a15461bb7c5dcff9 Jun 24 08:53:06.194009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:53:06.194009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-TestVolumeBootPattern-1314763452-project Jun 24 08:53:06.194009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:53:06.194009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:53:06.194009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 7f65bea891fb461086d6a60177ff2d65 Jun 24 08:53:06.194009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-TestVolumeBootPattern-1314763452-project Jun 24 08:53:06.194009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:53:06.194009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 1f39324f-89be-4fb8-af15-a44da05f0f48 could not be found. Jun 24 08:53:06.194009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '1f39324f-89be-4fb8-af15-a44da05f0f48'} Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f39324f-89be-4fb8-af15-a44da05f0f48 could not be found. Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:53:06.194949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f39324f-89be-4fb8-af15-a44da05f0f48 could not be found. Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f39324f-89be-4fb8-af15-a44da05f0f48 could not be found. Jun 24 08:53:06.196581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:06.198076 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e0f97260-25b3-4814-a06e-0315973728b4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Returning 404 to user: Instance 1f39324f-89be-4fb8-af15-a44da05f0f48 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:53:06.198076 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e0f97260-25b3-4814-a06e-0315973728b4 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48" status: 404 len: 111 microversion: 2.1 time: 0.029362 Jun 24 08:53:06.198076 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 495/963] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:06 2022] GET /compute/v2.1/servers/1f39324f-89be-4fb8-af15-a44da05f0f48 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:53:09.219792 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e2bf59ce-5b04-4a42-8083-3d9c99457d80 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:09.220401 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e2bf59ce-5b04-4a42-8083-3d9c99457d80 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:09.227981 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-1f8eeaeb-e684-4e95-89aa-884d0528ddb0 req-429361dd-6bee-44a5-9988-240df7bf8399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c15d41a9-3945-4a86-9819-9aa482844185", "tag": "a9e44c39-bcf3-4487-bdfd-a74976023909"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:09.235870 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-1f8eeaeb-e684-4e95-89aa-884d0528ddb0 req-429361dd-6bee-44a5-9988-240df7bf8399 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:09.236932 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2bf59ce-5b04-4a42-8083-3d9c99457d80 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:09.237057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-1f8eeaeb-e684-4e95-89aa-884d0528ddb0 req-429361dd-6bee-44a5-9988-240df7bf8399 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:09.237498 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2bf59ce-5b04-4a42-8083-3d9c99457d80 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:09.238351 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2bf59ce-5b04-4a42-8083-3d9c99457d80 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:09.238866 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e2bf59ce-5b04-4a42-8083-3d9c99457d80 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:09.247877 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-1f8eeaeb-e684-4e95-89aa-884d0528ddb0 req-429361dd-6bee-44a5-9988-240df7bf8399 service nova] Creating event network-changed:a9e44c39-bcf3-4487-bdfd-a74976023909 for instance c15d41a9-3945-4a86-9819-9aa482844185 on hv-cinder-84517 Jun 24 08:53:09.253012 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-1f8eeaeb-e684-4e95-89aa-884d0528ddb0 req-429361dd-6bee-44a5-9988-240df7bf8399 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028558 Jun 24 08:53:09.253784 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 496/964] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:09.265055 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e2bf59ce-5b04-4a42-8083-3d9c99457d80 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:53:09.352343 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e2bf59ce-5b04-4a42-8083-3d9c99457d80 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 204 len: 0 microversion: 2.1 time: 0.137104 Jun 24 08:53:09.353252 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 469/965] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:53:09 2022] DELETE /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:53:09.366891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c7b93645-bc6e-4362-90e4-e28070f80665 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:09.367892 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c7b93645-bc6e-4362-90e4-e28070f80665 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:09.380793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c7b93645-bc6e-4362-90e4-e28070f80665 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:09.381248 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c7b93645-bc6e-4362-90e4-e28070f80665 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:09.382224 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c7b93645-bc6e-4362-90e4-e28070f80665 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:09.382826 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c7b93645-bc6e-4362-90e4-e28070f80665 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:09.524944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c7b93645-bc6e-4362-90e4-e28070f80665 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:09.532431 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c7b93645-bc6e-4362-90e4-e28070f80665 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1576 microversion: 2.1 time: 0.171892 Jun 24 08:53:09.533004 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 497/966] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:09 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:10.550802 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4f3be064-da9f-45fa-bdbf-cb253c3e463f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:10.551534 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4f3be064-da9f-45fa-bdbf-cb253c3e463f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:10.557758 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4f3be064-da9f-45fa-bdbf-cb253c3e463f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:10.558209 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4f3be064-da9f-45fa-bdbf-cb253c3e463f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:10.558982 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4f3be064-da9f-45fa-bdbf-cb253c3e463f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:10.559441 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4f3be064-da9f-45fa-bdbf-cb253c3e463f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:10.695257 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4f3be064-da9f-45fa-bdbf-cb253c3e463f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:10.702641 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4f3be064-da9f-45fa-bdbf-cb253c3e463f tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1576 microversion: 2.1 time: 0.156469 Jun 24 08:53:10.703225 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 470/967] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:10 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:11.720094 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a50d78bc-9e93-4a65-a9e0-2f50bc09fd4e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:11.722464 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a50d78bc-9e93-4a65-a9e0-2f50bc09fd4e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:11.732577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a50d78bc-9e93-4a65-a9e0-2f50bc09fd4e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:11.733467 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a50d78bc-9e93-4a65-a9e0-2f50bc09fd4e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:11.734156 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a50d78bc-9e93-4a65-a9e0-2f50bc09fd4e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:11.734594 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a50d78bc-9e93-4a65-a9e0-2f50bc09fd4e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:11.767045 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-8890308b-bf3b-4bb8-9d86-7afa509dca38 req-33234260-1180-4154-801f-573aac4a6aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c15d41a9-3945-4a86-9819-9aa482844185", "name": "network-vif-deleted", "tag": "a9e44c39-bcf3-4487-bdfd-a74976023909"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:11.778702 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-8890308b-bf3b-4bb8-9d86-7afa509dca38 req-33234260-1180-4154-801f-573aac4a6aa7 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:11.779408 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-8890308b-bf3b-4bb8-9d86-7afa509dca38 req-33234260-1180-4154-801f-573aac4a6aa7 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:11.794032 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-8890308b-bf3b-4bb8-9d86-7afa509dca38 req-33234260-1180-4154-801f-573aac4a6aa7 service nova] Creating event network-vif-deleted:a9e44c39-bcf3-4487-bdfd-a74976023909 for instance c15d41a9-3945-4a86-9819-9aa482844185 on hv-cinder-84517 Jun 24 08:53:11.800896 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a50d78bc-9e93-4a65-a9e0-2f50bc09fd4e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f65bea891fb461086d6a60177ff2d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891980c3542d4223a15461bb7c5dcff9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:11.803777 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-8890308b-bf3b-4bb8-9d86-7afa509dca38 req-33234260-1180-4154-801f-573aac4a6aa7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040292 Jun 24 08:53:11.804377 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 471/968] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:53:11.808631 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a50d78bc-9e93-4a65-a9e0-2f50bc09fd4e tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 200 len: 1390 microversion: 2.1 time: 0.093532 Jun 24 08:53:11.809387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 498/969] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:11 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:12.827030 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3498cfd6-6007-439f-aa01-3011f723bdc5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:12.827748 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3498cfd6-6007-439f-aa01-3011f723bdc5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: c15d41a9-3945-4a86-9819-9aa482844185] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:12.834379 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3498cfd6-6007-439f-aa01-3011f723bdc5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:12.834854 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3498cfd6-6007-439f-aa01-3011f723bdc5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:12.835631 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3498cfd6-6007-439f-aa01-3011f723bdc5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:12.836063 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3498cfd6-6007-439f-aa01-3011f723bdc5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:12.849483 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-3498cfd6-6007-439f-aa01-3011f723bdc5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] HTTP exception thrown: Instance c15d41a9-3945-4a86-9819-9aa482844185 could not be found. Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3498cfd6-6007-439f-aa01-3011f723bdc5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Request method failure captured: Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 HTTP/1.1 Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXlvcj740GAXS8rpxFHO7HajxPWrmwYlx3RSIokdv0haB_yxqHtwAjETWOIhVbbqRtRcvAEVLPxozLuxna8w1m4vBt-7lOfpH_NDmJC7yngKQO3Aw6fr_Dh3KrosQWmzqzDvLmNOh6xLnDUq6VXwhYma19B_7h5bh5qaV_rPKbKnoKM Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 891980c3542d4223a15461bb7c5dcff9 Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:53:12.851069 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:53:12.852738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_891980c3542d4223a15461bb7c5dcff9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:53:12.852738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:53:12.852738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 891980c3542d4223a15461bb7c5dcff9 Jun 24 08:53:12.852738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:53:12.852738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-TestVolumeBootPattern-1314763452-project Jun 24 08:53:12.852738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:53:12.852738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:53:12.852738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 7f65bea891fb461086d6a60177ff2d65 Jun 24 08:53:12.852738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-TestVolumeBootPattern-1314763452-project Jun 24 08:53:12.852738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:53:12.852738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance c15d41a9-3945-4a86-9819-9aa482844185 could not be found. Jun 24 08:53:12.852738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': 'c15d41a9-3945-4a86-9819-9aa482844185'} Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c15d41a9-3945-4a86-9819-9aa482844185 could not be found. Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:53:12.853678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c15d41a9-3945-4a86-9819-9aa482844185 could not be found. Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c15d41a9-3945-4a86-9819-9aa482844185 could not be found. Jun 24 08:53:12.855187 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:53:12.856575 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3498cfd6-6007-439f-aa01-3011f723bdc5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Returning 404 to user: Instance c15d41a9-3945-4a86-9819-9aa482844185 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:53:12.856575 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3498cfd6-6007-439f-aa01-3011f723bdc5 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185" status: 404 len: 111 microversion: 2.1 time: 0.029706 Jun 24 08:53:12.856575 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 472/970] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:12 2022] GET /compute/v2.1/servers/c15d41a9-3945-4a86-9819-9aa482844185 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:53:13.294395 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a5ab2acc-9078-497b-bc4c-df8507d5c885 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:13.294895 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a5ab2acc-9078-497b-bc4c-df8507d5c885 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:13.301406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5ab2acc-9078-497b-bc4c-df8507d5c885 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:13.301852 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5ab2acc-9078-497b-bc4c-df8507d5c885 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:13.302607 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5ab2acc-9078-497b-bc4c-df8507d5c885 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:13.303038 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a5ab2acc-9078-497b-bc4c-df8507d5c885 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:13.316276 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-a5ab2acc-9078-497b-bc4c-df8507d5c885 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] HTTP exception thrown: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a5ab2acc-9078-497b-bc4c-df8507d5c885 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Request method failure captured: Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 HTTP/1.1 Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXlvcj740GAXS8rpxFHO7HajxPWrmwYlx3RSIokdv0haB_yxqHtwAjETWOIhVbbqRtRcvAEVLPxozLuxna8w1m4vBt-7lOfpH_NDmJC7yngKQO3Aw6fr_Dh3KrosQWmzqzDvLmNOh6xLnDUq6VXwhYma19B_7h5bh5qaV_rPKbKnoKM Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 891980c3542d4223a15461bb7c5dcff9 Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:53:13.317914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:53:13.319488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_891980c3542d4223a15461bb7c5dcff9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:53:13.319488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:53:13.319488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 891980c3542d4223a15461bb7c5dcff9 Jun 24 08:53:13.319488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:53:13.319488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-TestVolumeBootPattern-1314763452-project Jun 24 08:53:13.319488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:53:13.319488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:53:13.319488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 7f65bea891fb461086d6a60177ff2d65 Jun 24 08:53:13.319488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-TestVolumeBootPattern-1314763452-project Jun 24 08:53:13.319488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:53:13.319488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:53:13.319488 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '7361cf5e-5979-4b93-97db-69e8a678dfa3'} Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:53:13.320387 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:53:13.321881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:13.323316 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a5ab2acc-9078-497b-bc4c-df8507d5c885 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Returning 404 to user: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:53:13.323316 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a5ab2acc-9078-497b-bc4c-df8507d5c885 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 404 len: 111 microversion: 2.1 time: 0.028740 Jun 24 08:53:13.323316 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 499/971] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:53:13 2022] DELETE /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:53:13.327691 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-68b7df93-a91d-4a37-ae00-42e8e7bdff31 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:13.328308 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-68b7df93-a91d-4a37-ae00-42e8e7bdff31 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] [instance: 7361cf5e-5979-4b93-97db-69e8a678dfa3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:13.334727 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68b7df93-a91d-4a37-ae00-42e8e7bdff31 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:13.335172 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68b7df93-a91d-4a37-ae00-42e8e7bdff31 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:13.335956 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68b7df93-a91d-4a37-ae00-42e8e7bdff31 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:13.336392 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-68b7df93-a91d-4a37-ae00-42e8e7bdff31 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:13.349936 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-68b7df93-a91d-4a37-ae00-42e8e7bdff31 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] HTTP exception thrown: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-68b7df93-a91d-4a37-ae00-42e8e7bdff31 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Request method failure captured: Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 HTTP/1.1 Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXlvcj740GAXS8rpxFHO7HajxPWrmwYlx3RSIokdv0haB_yxqHtwAjETWOIhVbbqRtRcvAEVLPxozLuxna8w1m4vBt-7lOfpH_NDmJC7yngKQO3Aw6fr_Dh3KrosQWmzqzDvLmNOh6xLnDUq6VXwhYma19B_7h5bh5qaV_rPKbKnoKM Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 891980c3542d4223a15461bb7c5dcff9 Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:53:13.351468 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:53:13.353096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_891980c3542d4223a15461bb7c5dcff9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/891980c3542d4223a15461bb7c5dcff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:53:13.353096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:53:13.353096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 891980c3542d4223a15461bb7c5dcff9 Jun 24 08:53:13.353096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-TestVolumeBootPattern-1314763452 Jun 24 08:53:13.353096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-TestVolumeBootPattern-1314763452-project Jun 24 08:53:13.353096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:53:13.353096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:53:13.353096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 7f65bea891fb461086d6a60177ff2d65 Jun 24 08:53:13.353096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-TestVolumeBootPattern-1314763452-project Jun 24 08:53:13.353096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:53:13.353096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:53:13.353096 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': '7361cf5e-5979-4b93-97db-69e8a678dfa3'} Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:53:13.353945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. Jun 24 08:53:13.355415 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:53:13.356728 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-68b7df93-a91d-4a37-ae00-42e8e7bdff31 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Returning 404 to user: Instance 7361cf5e-5979-4b93-97db-69e8a678dfa3 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:53:13.356728 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-68b7df93-a91d-4a37-ae00-42e8e7bdff31 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3" status: 404 len: 111 microversion: 2.1 time: 0.028922 Jun 24 08:53:13.356728 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 473/972] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:13 2022] GET /compute/v2.1/servers/7361cf5e-5979-4b93-97db-69e8a678dfa3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:53:14.874456 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b2c71afe-76e8-4bf9-8297-d068f6b62fe3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] Calling method '.version_select at 0x7fb75c871670>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:14.893504 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b2c71afe-76e8-4bf9-8297-d068f6b62fe3 tempest-TestVolumeBootPattern-1314763452 tempest-TestVolumeBootPattern-1314763452-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1167158324" status: 202 len: 0 microversion: 2.1 time: 0.022967 Jun 24 08:53:14.894062 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 500/973] 10.222.0.43 () {58 vars in 1262 bytes} [Fri Jun 24 08:53:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1167158324 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:53:21.654015 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-24263ee4-ce53-4a11-9e48-d7561b525faa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:21.655153 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-24263ee4-ce53-4a11-9e48-d7561b525faa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:21.662922 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-24263ee4-ce53-4a11-9e48-d7561b525faa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:21.663605 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-24263ee4-ce53-4a11-9e48-d7561b525faa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:21.664626 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-24263ee4-ce53-4a11-9e48-d7561b525faa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:21.665197 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-24263ee4-ce53-4a11-9e48-d7561b525faa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:21.689678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-24263ee4-ce53-4a11-9e48-d7561b525faa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/ips" status: 200 len: 149 microversion: 2.1 time: 0.039491 Jun 24 08:53:21.690244 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 474/974] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Jun 24 08:53:21 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:23.064351 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c875e0d2-f21f-41b2-98d7-bbc3e90db3fe tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6bda097-ff31-4f4d-b2b4-38bd1b52bf71"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:23.065398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c875e0d2-f21f-41b2-98d7-bbc3e90db3fe tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:23.071398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c875e0d2-f21f-41b2-98d7-bbc3e90db3fe tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:23.071848 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c875e0d2-f21f-41b2-98d7-bbc3e90db3fe tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:23.072611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c875e0d2-f21f-41b2-98d7-bbc3e90db3fe tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:23.073044 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c875e0d2-f21f-41b2-98d7-bbc3e90db3fe tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:23.335931 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c875e0d2-f21f-41b2-98d7-bbc3e90db3fe tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "POST /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275456 Jun 24 08:53:23.337224 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 501/975] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Jun 24 08:53:23 2022] POST /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:30.399503 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e0573496-4dad-4344-862f-93b28d381f59 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:30.400431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e0573496-4dad-4344-862f-93b28d381f59 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:30.406873 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0573496-4dad-4344-862f-93b28d381f59 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:30.407363 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0573496-4dad-4344-862f-93b28d381f59 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:30.408124 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0573496-4dad-4344-862f-93b28d381f59 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:30.408560 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e0573496-4dad-4344-862f-93b28d381f59 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:30.436949 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e0573496-4dad-4344-862f-93b28d381f59 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041326 Jun 24 08:53:30.437427 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 475/976] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:30 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:53:30.493858 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-68e8754b-c975-482a-aa59-1a973b301285 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:30.494441 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-68e8754b-c975-482a-aa59-1a973b301285 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:30.500620 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68e8754b-c975-482a-aa59-1a973b301285 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:30.501100 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68e8754b-c975-482a-aa59-1a973b301285 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:30.501854 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68e8754b-c975-482a-aa59-1a973b301285 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:30.502919 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-68e8754b-c975-482a-aa59-1a973b301285 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:30.526728 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-68e8754b-c975-482a-aa59-1a973b301285 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:53:30.601662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-68e8754b-c975-482a-aa59-1a973b301285 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "DELETE /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 204 len: 0 microversion: 2.1 time: 0.112119 Jun 24 08:53:30.602424 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 502/977] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:53:30 2022] DELETE /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:53:30.610733 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b41acf72-fbb9-4440-92ed-5688b73e7369 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:30.611374 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b41acf72-fbb9-4440-92ed-5688b73e7369 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:30.617222 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b41acf72-fbb9-4440-92ed-5688b73e7369 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:30.617662 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b41acf72-fbb9-4440-92ed-5688b73e7369 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:30.618410 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b41acf72-fbb9-4440-92ed-5688b73e7369 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:30.618841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b41acf72-fbb9-4440-92ed-5688b73e7369 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:30.745372 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b41acf72-fbb9-4440-92ed-5688b73e7369 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:30.753262 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b41acf72-fbb9-4440-92ed-5688b73e7369 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1673 microversion: 2.1 time: 0.146669 Jun 24 08:53:30.753806 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 476/978] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:30 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:53:30.813959 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bd8ef1ff-0dd4-4846-bdbe-93a2268a171c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Action: 'create', calling method: .version_select at 0x7fb75c8f0b80>, body: {"keypair": {"name": "tempest-keypair-1966228831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3pMEcBh9Go3MxH2EP04ziqX3lVLLxJSvaWmm6zp6U5h/EMhK4cKpojuYKmuHG6XEZ8GnMRGOB0BixSBtG71PGjPJRcU5OqXE398BsCCdydBT1N2NjU6fjiSk3kHVUtPw=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:30.828619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-bd8ef1ff-0dd4-4846-bdbe-93a2268a171c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for project 0ae612a1712a404681313b8758eb4f2d. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:53:30.833122 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-bd8ef1ff-0dd4-4846-bdbe-93a2268a171c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for user 8d3b1f091b4644d3b15b66eee01271c6 and project 0ae612a1712a404681313b8758eb4f2d. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:53:30.854467 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bd8ef1ff-0dd4-4846-bdbe-93a2268a171c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044717 Jun 24 08:53:30.855045 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 503/979] 10.222.0.43 () {60 vars in 1158 bytes} [Fri Jun 24 08:53:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:31.769863 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9c891f11-5fde-4a35-827c-5841983560c6 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:31.770575 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9c891f11-5fde-4a35-827c-5841983560c6 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:31.777093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c891f11-5fde-4a35-827c-5841983560c6 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:31.777614 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c891f11-5fde-4a35-827c-5841983560c6 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:31.778465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c891f11-5fde-4a35-827c-5841983560c6 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:31.779037 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9c891f11-5fde-4a35-827c-5841983560c6 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:31.914086 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9c891f11-5fde-4a35-827c-5841983560c6 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:31.921920 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9c891f11-5fde-4a35-827c-5841983560c6 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1673 microversion: 2.1 time: 0.155954 Jun 24 08:53:31.922506 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 477/980] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:31 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:32.330002 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1905620456", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "088f6f07-6d3f-4c03-8832-f8bccdce4c55"}], "security_groups": [{"name": "tempest-securitygroup--300808110"}], "key_name": "tempest-keypair-1966228831", "user_data": "}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:32.427612 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] validate_networks() for [('088f6f07-6d3f-4c03-8832-f8bccdce4c55', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:53:32.604487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:32.892140 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:53:32.892638 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:53:32.893334 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:53:32.893883 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:53:32.894356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:53:32.903179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:32.903730 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:32.904594 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:32.905096 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:32.911809 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:32.923868 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for project 0ae612a1712a404681313b8758eb4f2d. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:53:32.929607 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for user 8d3b1f091b4644d3b15b66eee01271c6 and project 0ae612a1712a404681313b8758eb4f2d. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:53:32.940459 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d0e4d918-1e59-4732-b58a-91e1b9ed74b9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:32.941236 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d0e4d918-1e59-4732-b58a-91e1b9ed74b9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:32.941478 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:53:32.943985 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:32.944125 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:53:32.949470 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d0e4d918-1e59-4732-b58a-91e1b9ed74b9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:32.950199 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d0e4d918-1e59-4732-b58a-91e1b9ed74b9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:32.951044 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d0e4d918-1e59-4732-b58a-91e1b9ed74b9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:32.951568 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d0e4d918-1e59-4732-b58a-91e1b9ed74b9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:32.956304 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:32.996616 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-fa136df4-2fed-43b5-bdfe-367e90f4b91c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.671384 Jun 24 08:53:32.997764 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 504/981] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:53:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:53:33.008601 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5c88bec9-c027-475d-9ee7-0c7e8ddf63ac tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:33.010192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5c88bec9-c027-475d-9ee7-0c7e8ddf63ac tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:33.087258 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-5c88bec9-c027-475d-9ee7-0c7e8ddf63ac tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:33.097201 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5c88bec9-c027-475d-9ee7-0c7e8ddf63ac tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 200 len: 1242 microversion: 2.1 time: 0.093129 Jun 24 08:53:33.098326 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 505/982] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:33 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:33.123810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d0e4d918-1e59-4732-b58a-91e1b9ed74b9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:33.132072 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d0e4d918-1e59-4732-b58a-91e1b9ed74b9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1673 microversion: 2.1 time: 0.196256 Jun 24 08:53:33.132959 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 478/983] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:32 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1673 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:53:33.667137 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-f18d04fb-ff65-45e5-8c23-ff99c2869cb8 req-62422db6-fa30-40da-83c6-bc461627f492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77cd8982-eb26-429b-ba63-c8f02412f7c3", "name": "network-vif-deleted", "tag": "ac731d01-8032-4238-b050-e3f4a4ae9998"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:33.677603 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-f18d04fb-ff65-45e5-8c23-ff99c2869cb8 req-62422db6-fa30-40da-83c6-bc461627f492 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:33.678331 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-f18d04fb-ff65-45e5-8c23-ff99c2869cb8 req-62422db6-fa30-40da-83c6-bc461627f492 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:33.693796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-f18d04fb-ff65-45e5-8c23-ff99c2869cb8 req-62422db6-fa30-40da-83c6-bc461627f492 service nova] Creating event network-vif-deleted:ac731d01-8032-4238-b050-e3f4a4ae9998 for instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 on hv-cinder-84517 Jun 24 08:53:33.708049 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-f18d04fb-ff65-45e5-8c23-ff99c2869cb8 req-62422db6-fa30-40da-83c6-bc461627f492 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045596 Jun 24 08:53:33.716833 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 506/984] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:34.114021 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1c0db4ab-ee9e-473e-8b8c-cf1cba43d14b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:34.114806 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1c0db4ab-ee9e-473e-8b8c-cf1cba43d14b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:34.121941 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1c0db4ab-ee9e-473e-8b8c-cf1cba43d14b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:34.122432 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1c0db4ab-ee9e-473e-8b8c-cf1cba43d14b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:34.123287 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1c0db4ab-ee9e-473e-8b8c-cf1cba43d14b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:34.123729 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1c0db4ab-ee9e-473e-8b8c-cf1cba43d14b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:34.150786 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b5d8c566-a84b-4561-b1b4-b3979ed79c70 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:34.151646 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b5d8c566-a84b-4561-b1b4-b3979ed79c70 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:34.160292 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b5d8c566-a84b-4561-b1b4-b3979ed79c70 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:34.161103 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b5d8c566-a84b-4561-b1b4-b3979ed79c70 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:34.162271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b5d8c566-a84b-4561-b1b4-b3979ed79c70 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:34.163120 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b5d8c566-a84b-4561-b1b4-b3979ed79c70 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:34.202924 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b5d8c566-a84b-4561-b1b4-b3979ed79c70 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:34.203664 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b5d8c566-a84b-4561-b1b4-b3979ed79c70 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:34.204349 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-b5d8c566-a84b-4561-b1b4-b3979ed79c70 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lazy-loading 'fault' on Instance uuid 77cd8982-eb26-429b-ba63-c8f02412f7c3 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:53:34.209569 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1c0db4ab-ee9e-473e-8b8c-cf1cba43d14b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:34.217461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1c0db4ab-ee9e-473e-8b8c-cf1cba43d14b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 200 len: 1294 microversion: 2.1 time: 0.107437 Jun 24 08:53:34.218350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 479/985] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:34 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 1294 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:34.246512 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b5d8c566-a84b-4561-b1b4-b3979ed79c70 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:34.253940 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b5d8c566-a84b-4561-b1b4-b3979ed79c70 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 200 len: 1327 microversion: 2.1 time: 0.107795 Jun 24 08:53:34.254496 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 507/986] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:34 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:53:35.236305 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-370b9102-892a-49be-a10f-3156447d4de9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:35.237895 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-370b9102-892a-49be-a10f-3156447d4de9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:35.245572 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-370b9102-892a-49be-a10f-3156447d4de9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:35.246031 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-370b9102-892a-49be-a10f-3156447d4de9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:35.246808 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-370b9102-892a-49be-a10f-3156447d4de9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:35.247458 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-370b9102-892a-49be-a10f-3156447d4de9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:35.271816 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1c91982e-c365-43e0-a868-7c21b12ac70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:35.272497 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1c91982e-c365-43e0-a868-7c21b12ac70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:35.283280 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c91982e-c365-43e0-a868-7c21b12ac70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:35.283820 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c91982e-c365-43e0-a868-7c21b12ac70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:35.284969 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c91982e-c365-43e0-a868-7c21b12ac70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:35.285582 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1c91982e-c365-43e0-a868-7c21b12ac70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:35.301619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-1c91982e-c365-43e0-a868-7c21b12ac70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] HTTP exception thrown: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1c91982e-c365-43e0-a868-7c21b12ac70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Request method failure captured: Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 HTTP/1.1 Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXp2g7INMFAtfJAUF_1A_uKfb-a0S5yPMfSZA41X8Se2ec3QMtj33hNlx-3lswtES3y8sYnlnJZHa4yVvfT1Jw0GVKrr7iJOaUk90y7CPtITkFFOTHWQ9rHCeVZbBQk4pEaZSzYEQ1dX5agcq11hXjS3Z-a084gxZaDfRA1Kjly8cbk Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: f7c692366d8d456ba98167614a0921f0 Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:53:35.303683 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:53:35.305155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f7c692366d8d456ba98167614a0921f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:53:35.305155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:53:35.305155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: f7c692366d8d456ba98167614a0921f0 Jun 24 08:53:35.305155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:53:35.305155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeTestJSON-709227540-project Jun 24 08:53:35.305155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:53:35.305155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:53:35.305155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 063272f0c2054a53b831b35abf405b20 Jun 24 08:53:35.305155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeTestJSON-709227540-project Jun 24 08:53:35.305155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:53:35.305155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:53:35.305155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '77cd8982-eb26-429b-ba63-c8f02412f7c3'} Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:53:35.305970 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:53:35.307348 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:53:35.310019 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1c91982e-c365-43e0-a868-7c21b12ac70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Returning 404 to user: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:53:35.310019 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1c91982e-c365-43e0-a868-7c21b12ac70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 404 len: 111 microversion: 2.1 time: 0.038004 Jun 24 08:53:35.310019 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 508/987] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:35 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:53:35.328051 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f9171db1-d169-4427-ac08-4cae844a7da8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '.version_select at 0x7fb75c6c5b80>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:35.368817 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f9171db1-d169-4427-ac08-4cae844a7da8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-100210827" status: 202 len: 0 microversion: 2.1 time: 0.049499 Jun 24 08:53:35.369536 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 509/988] 10.222.0.43 () {58 vars in 1217 bytes} [Fri Jun 24 08:53:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-100210827 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:53:35.433575 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-370b9102-892a-49be-a10f-3156447d4de9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:35.442262 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-370b9102-892a-49be-a10f-3156447d4de9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 200 len: 1367 microversion: 2.1 time: 0.210359 Jun 24 08:53:35.442824 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 480/989] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:35 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:35.838399 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-259ecceb-7974-444b-9cdf-472e177fb1c4 req-70f99486-ef4c-4ff0-853c-a9d79977d8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e34ef5-87e8-412a-bfd4-30e2b8918b30", "tag": "f561a1f2-cbdb-4c8d-aeec-d3853b83ccb7"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:35.848577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-259ecceb-7974-444b-9cdf-472e177fb1c4 req-70f99486-ef4c-4ff0-853c-a9d79977d8f3 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:35.849307 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-259ecceb-7974-444b-9cdf-472e177fb1c4 req-70f99486-ef4c-4ff0-853c-a9d79977d8f3 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:35.862889 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-259ecceb-7974-444b-9cdf-472e177fb1c4 req-70f99486-ef4c-4ff0-853c-a9d79977d8f3 service nova] Creating event network-changed:f561a1f2-cbdb-4c8d-aeec-d3853b83ccb7 for instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 on hv-cinder-84517 Jun 24 08:53:35.868036 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-259ecceb-7974-444b-9cdf-472e177fb1c4 req-70f99486-ef4c-4ff0-853c-a9d79977d8f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039412 Jun 24 08:53:35.869129 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 510/990] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:53:36.079550 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-41a56eb8-81ab-43d5-b3e5-6cd4d47e07bd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Action: 'create', calling method: .version_select at 0x7fb75cb97b80>, body: {"keypair": {"name": "tempest-keypair-985399154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5YKpgWJyX9OLxgKjV8/bw6BrC/mBuXMQeLz0geDB1z30eBsV+li3sY+F0IkkNiA66b+Gxyuyl2T4p/MmIl4KgA7+RxP69yDhdMbW9UdkL53/HeV7i1WDqxzpfQOcipkw=="}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:36.094198 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-41a56eb8-81ab-43d5-b3e5-6cd4d47e07bd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Getting quotas for project f7c692366d8d456ba98167614a0921f0. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:53:36.098517 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-41a56eb8-81ab-43d5-b3e5-6cd4d47e07bd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Getting quotas for user 063272f0c2054a53b831b35abf405b20 and project f7c692366d8d456ba98167614a0921f0. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:53:36.123508 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-41a56eb8-81ab-43d5-b3e5-6cd4d47e07bd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047974 Jun 24 08:53:36.124357 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 481/991] 10.222.0.43 () {60 vars in 1158 bytes} [Fri Jun 24 08:53:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:53:36.460611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b8f15591-7290-4750-97e8-7d977757e0b8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:36.461428 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b8f15591-7290-4750-97e8-7d977757e0b8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:36.467616 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b8f15591-7290-4750-97e8-7d977757e0b8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:36.468072 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b8f15591-7290-4750-97e8-7d977757e0b8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:36.468829 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b8f15591-7290-4750-97e8-7d977757e0b8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:36.469262 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b8f15591-7290-4750-97e8-7d977757e0b8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:36.677691 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-b8f15591-7290-4750-97e8-7d977757e0b8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:36.685036 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b8f15591-7290-4750-97e8-7d977757e0b8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 200 len: 1367 microversion: 2.1 time: 0.229717 Jun 24 08:53:36.685592 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 511/992] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:36 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:37.437484 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-580291793", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51ff3af8-93b9-4b5c-af0e-0b6a38331957"}], "security_groups": [{"name": "tempest-securitygroup--1353934361"}], "key_name": "tempest-keypair-985399154", "user_data": "}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:37.539048 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] validate_networks() for [('51ff3af8-93b9-4b5c-af0e-0b6a38331957', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:53:37.701580 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-87d93e21-8477-4f8f-af2a-60c90396277c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:37.702195 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-87d93e21-8477-4f8f-af2a-60c90396277c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:37.708599 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87d93e21-8477-4f8f-af2a-60c90396277c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:37.709046 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87d93e21-8477-4f8f-af2a-60c90396277c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:37.709805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87d93e21-8477-4f8f-af2a-60c90396277c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:37.710234 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-87d93e21-8477-4f8f-af2a-60c90396277c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:37.916412 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-87d93e21-8477-4f8f-af2a-60c90396277c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:37.924184 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-87d93e21-8477-4f8f-af2a-60c90396277c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 200 len: 1367 microversion: 2.1 time: 0.226374 Jun 24 08:53:37.924758 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 512/993] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:37 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:53:38.009314 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:53:38.009742 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:53:38.010217 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:53:38.010631 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:53:38.011041 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:53:38.020282 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:38.020734 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:38.021530 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:38.021967 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:38.038769 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Getting quotas for project f7c692366d8d456ba98167614a0921f0. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:53:38.042693 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Getting quotas for user 063272f0c2054a53b831b35abf405b20 and project f7c692366d8d456ba98167614a0921f0. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:53:38.053885 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:53:38.056137 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:53:38.101884 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1369e88c-e1b0-4fc0-81b1-49ee2754aafd tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.669055 Jun 24 08:53:38.106708 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 482/994] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:53:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:53:38.112614 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7e611d3d-2d4b-4530-9e85-bf0c09d14a36 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:38.113468 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7e611d3d-2d4b-4530-9e85-bf0c09d14a36 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:38.168108 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7e611d3d-2d4b-4530-9e85-bf0c09d14a36 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:38.176065 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7e611d3d-2d4b-4530-9e85-bf0c09d14a36 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 200 len: 1236 microversion: 2.1 time: 0.066896 Jun 24 08:53:38.185559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 513/995] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:38 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:38.941450 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8553d2dc-36e0-4368-b165-8f10a66ad7bf tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:38.942062 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8553d2dc-36e0-4368-b165-8f10a66ad7bf tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:38.948798 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8553d2dc-36e0-4368-b165-8f10a66ad7bf tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:38.949243 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8553d2dc-36e0-4368-b165-8f10a66ad7bf tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:38.950008 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8553d2dc-36e0-4368-b165-8f10a66ad7bf tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:38.950454 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8553d2dc-36e0-4368-b165-8f10a66ad7bf tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:39.195052 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a0e8f543-df4f-4ddf-a4d5-9d1efabe4f24 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:39.195764 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a0e8f543-df4f-4ddf-a4d5-9d1efabe4f24 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:39.205082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a0e8f543-df4f-4ddf-a4d5-9d1efabe4f24 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:39.205844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a0e8f543-df4f-4ddf-a4d5-9d1efabe4f24 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:39.207013 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a0e8f543-df4f-4ddf-a4d5-9d1efabe4f24 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:39.207638 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a0e8f543-df4f-4ddf-a4d5-9d1efabe4f24 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:39.374984 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a0e8f543-df4f-4ddf-a4d5-9d1efabe4f24 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:39.382623 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a0e8f543-df4f-4ddf-a4d5-9d1efabe4f24 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 200 len: 1294 microversion: 2.1 time: 0.192867 Jun 24 08:53:39.383529 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 514/996] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:39 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 1294 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:39.394055 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-8553d2dc-36e0-4368-b165-8f10a66ad7bf tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:39.401656 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8553d2dc-36e0-4368-b165-8f10a66ad7bf tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 200 len: 1367 microversion: 2.1 time: 0.465309 Jun 24 08:53:39.402210 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 483/997] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:38 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 1367 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:40.401500 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-de6244c3-0491-40a1-95cd-1e986fe3ed90 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:40.402131 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-de6244c3-0491-40a1-95cd-1e986fe3ed90 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:40.409307 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-de6244c3-0491-40a1-95cd-1e986fe3ed90 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:40.409755 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-de6244c3-0491-40a1-95cd-1e986fe3ed90 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:40.410712 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-de6244c3-0491-40a1-95cd-1e986fe3ed90 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:40.411151 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-de6244c3-0491-40a1-95cd-1e986fe3ed90 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:40.422137 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d485a71c-5089-4d01-9fca-1fbecf47ec7d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:40.422780 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d485a71c-5089-4d01-9fca-1fbecf47ec7d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:40.429693 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d485a71c-5089-4d01-9fca-1fbecf47ec7d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:40.430272 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d485a71c-5089-4d01-9fca-1fbecf47ec7d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:40.431166 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d485a71c-5089-4d01-9fca-1fbecf47ec7d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:40.431747 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d485a71c-5089-4d01-9fca-1fbecf47ec7d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:40.650271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-de6244c3-0491-40a1-95cd-1e986fe3ed90 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:40.654236 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d485a71c-5089-4d01-9fca-1fbecf47ec7d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:40.659111 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-de6244c3-0491-40a1-95cd-1e986fe3ed90 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 200 len: 1362 microversion: 2.1 time: 0.262163 Jun 24 08:53:40.663725 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d485a71c-5089-4d01-9fca-1fbecf47ec7d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 200 len: 1367 microversion: 2.1 time: 0.247887 Jun 24 08:53:40.664664 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 484/998] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:40 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:53:40.669723 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-2c1fc5d8-8bce-431d-89a2-12845113a2a7 req-7e7a812e-2021-441c-a3d2-e79de1941791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4913f95-67d9-469c-bcf4-b05690d5f068", "tag": "b59fbfe9-d95e-4785-a682-20d6fe959e2f"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:40.671694 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 515/999] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:40 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:40.679760 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-2c1fc5d8-8bce-431d-89a2-12845113a2a7 req-7e7a812e-2021-441c-a3d2-e79de1941791 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:40.680484 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-2c1fc5d8-8bce-431d-89a2-12845113a2a7 req-7e7a812e-2021-441c-a3d2-e79de1941791 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:40.697018 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-2c1fc5d8-8bce-431d-89a2-12845113a2a7 req-7e7a812e-2021-441c-a3d2-e79de1941791 service nova] Creating event network-changed:b59fbfe9-d95e-4785-a682-20d6fe959e2f for instance c4913f95-67d9-469c-bcf4-b05690d5f068 on hv-cinder-84517 Jun 24 08:53:40.702583 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-2c1fc5d8-8bce-431d-89a2-12845113a2a7 req-7e7a812e-2021-441c-a3d2-e79de1941791 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036523 Jun 24 08:53:40.703349 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 485/1000] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:41.684875 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bd0e5643-5822-4d23-be42-354ccb202f93 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:41.691866 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-759b4b3b-a0bc-4335-bc07-1df50a215eb8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:41.692589 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-759b4b3b-a0bc-4335-bc07-1df50a215eb8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:41.696252 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bd0e5643-5822-4d23-be42-354ccb202f93 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:41.699711 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-759b4b3b-a0bc-4335-bc07-1df50a215eb8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:41.700155 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-759b4b3b-a0bc-4335-bc07-1df50a215eb8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:41.701144 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-759b4b3b-a0bc-4335-bc07-1df50a215eb8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:41.701587 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-759b4b3b-a0bc-4335-bc07-1df50a215eb8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:41.703840 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bd0e5643-5822-4d23-be42-354ccb202f93 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:41.704358 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bd0e5643-5822-4d23-be42-354ccb202f93 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:41.705307 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bd0e5643-5822-4d23-be42-354ccb202f93 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:41.705741 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bd0e5643-5822-4d23-be42-354ccb202f93 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:41.901195 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bd0e5643-5822-4d23-be42-354ccb202f93 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:41.904991 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-759b4b3b-a0bc-4335-bc07-1df50a215eb8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:41.908869 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bd0e5643-5822-4d23-be42-354ccb202f93 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 200 len: 1362 microversion: 2.1 time: 0.227809 Jun 24 08:53:41.909522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 516/1001] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:41 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:41.912802 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-759b4b3b-a0bc-4335-bc07-1df50a215eb8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 200 len: 1367 microversion: 2.1 time: 0.226140 Jun 24 08:53:41.913583 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 486/1002] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:41 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:42.028285 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-2af4b07d-03a7-420a-933e-7d38da123833 req-6072a322-e192-4bb7-8eee-f27f6acfa7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e34ef5-87e8-412a-bfd4-30e2b8918b30", "name": "network-vif-plugged", "status": "completed", "tag": "f561a1f2-cbdb-4c8d-aeec-d3853b83ccb7"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:42.036718 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-2af4b07d-03a7-420a-933e-7d38da123833 req-6072a322-e192-4bb7-8eee-f27f6acfa7c9 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:42.037158 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-2af4b07d-03a7-420a-933e-7d38da123833 req-6072a322-e192-4bb7-8eee-f27f6acfa7c9 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:42.047803 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-2af4b07d-03a7-420a-933e-7d38da123833 req-6072a322-e192-4bb7-8eee-f27f6acfa7c9 service nova] Creating event network-vif-plugged:f561a1f2-cbdb-4c8d-aeec-d3853b83ccb7 for instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 on hv-cinder-84517 Jun 24 08:53:42.053637 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-2af4b07d-03a7-420a-933e-7d38da123833 req-6072a322-e192-4bb7-8eee-f27f6acfa7c9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142961 Jun 24 08:53:42.054199 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 517/1003] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:42.925626 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fe6ee564-16de-4438-b57e-7882aa9c47e9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:42.926245 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fe6ee564-16de-4438-b57e-7882aa9c47e9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:42.927616 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:42.932494 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4e8664ed-7417-4533-8950-8c8dba1153da tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:42.932943 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fe6ee564-16de-4438-b57e-7882aa9c47e9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:42.933351 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4e8664ed-7417-4533-8950-8c8dba1153da tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:42.933453 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fe6ee564-16de-4438-b57e-7882aa9c47e9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:42.934135 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fe6ee564-16de-4438-b57e-7882aa9c47e9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:42.934563 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fe6ee564-16de-4438-b57e-7882aa9c47e9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:42.940491 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4e8664ed-7417-4533-8950-8c8dba1153da tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:42.940946 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4e8664ed-7417-4533-8950-8c8dba1153da tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:42.941731 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4e8664ed-7417-4533-8950-8c8dba1153da tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:42.942169 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4e8664ed-7417-4533-8950-8c8dba1153da tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:43.139771 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-fe6ee564-16de-4438-b57e-7882aa9c47e9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:43.146300 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-4e8664ed-7417-4533-8950-8c8dba1153da tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:43.152743 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fe6ee564-16de-4438-b57e-7882aa9c47e9 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 200 len: 1362 microversion: 2.1 time: 0.231167 Jun 24 08:53:43.153935 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 487/1004] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:42 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:43.155901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4e8664ed-7417-4533-8950-8c8dba1153da tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 200 len: 1367 microversion: 2.1 time: 0.229601 Jun 24 08:53:43.156545 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 518/1005] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:42 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:53:44.169982 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e83eb9ff-0140-4ece-91c3-ddff3f9c08f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:44.170602 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e83eb9ff-0140-4ece-91c3-ddff3f9c08f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:44.177465 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e83eb9ff-0140-4ece-91c3-ddff3f9c08f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:44.177919 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e83eb9ff-0140-4ece-91c3-ddff3f9c08f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:44.178692 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e83eb9ff-0140-4ece-91c3-ddff3f9c08f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:44.179125 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e83eb9ff-0140-4ece-91c3-ddff3f9c08f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:44.180904 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-05a7c9c1-39f7-4f27-aa24-7a0d9b9f904d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:44.182438 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-05a7c9c1-39f7-4f27-aa24-7a0d9b9f904d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:44.189914 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-05a7c9c1-39f7-4f27-aa24-7a0d9b9f904d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:44.190358 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-05a7c9c1-39f7-4f27-aa24-7a0d9b9f904d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:44.191125 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-05a7c9c1-39f7-4f27-aa24-7a0d9b9f904d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:44.191581 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-05a7c9c1-39f7-4f27-aa24-7a0d9b9f904d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:44.379725 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e83eb9ff-0140-4ece-91c3-ddff3f9c08f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:44.382432 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-05a7c9c1-39f7-4f27-aa24-7a0d9b9f904d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:44.387101 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e83eb9ff-0140-4ece-91c3-ddff3f9c08f2 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 200 len: 1362 microversion: 2.1 time: 0.220993 Jun 24 08:53:44.387717 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 488/1006] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:44 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:44.390831 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-05a7c9c1-39f7-4f27-aa24-7a0d9b9f904d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 200 len: 1367 microversion: 2.1 time: 0.218268 Jun 24 08:53:44.391423 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 519/1007] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:44 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:45.404672 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-501c77d1-ff11-43ff-8130-c979716ec256 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:45.405269 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-501c77d1-ff11-43ff-8130-c979716ec256 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:45.408618 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e8791f28-ac7e-4c28-b899-29424ecf12fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:45.409232 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e8791f28-ac7e-4c28-b899-29424ecf12fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:45.412136 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-501c77d1-ff11-43ff-8130-c979716ec256 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:45.412589 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-501c77d1-ff11-43ff-8130-c979716ec256 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:45.413357 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-501c77d1-ff11-43ff-8130-c979716ec256 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:45.413791 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-501c77d1-ff11-43ff-8130-c979716ec256 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:45.415811 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e8791f28-ac7e-4c28-b899-29424ecf12fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:45.416258 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e8791f28-ac7e-4c28-b899-29424ecf12fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:45.417013 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e8791f28-ac7e-4c28-b899-29424ecf12fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:45.417446 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e8791f28-ac7e-4c28-b899-29424ecf12fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:45.609584 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-501c77d1-ff11-43ff-8130-c979716ec256 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:45.613057 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e8791f28-ac7e-4c28-b899-29424ecf12fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:45.617391 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-501c77d1-ff11-43ff-8130-c979716ec256 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 200 len: 1362 microversion: 2.1 time: 0.216883 Jun 24 08:53:45.617953 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 489/1008] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:45 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:53:45.621200 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e8791f28-ac7e-4c28-b899-29424ecf12fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 200 len: 1557 microversion: 2.1 time: 0.216946 Jun 24 08:53:45.630974 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 520/1009] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:45 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 1557 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:53:45.637151 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-86b9b854-2303-40d6-bbd5-cb8a6896fc1e tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:45.637644 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-86b9b854-2303-40d6-bbd5-cb8a6896fc1e tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:45.644244 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86b9b854-2303-40d6-bbd5-cb8a6896fc1e tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:45.644766 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86b9b854-2303-40d6-bbd5-cb8a6896fc1e tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:45.645632 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86b9b854-2303-40d6-bbd5-cb8a6896fc1e tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:45.646068 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-86b9b854-2303-40d6-bbd5-cb8a6896fc1e tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:45.724971 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-335045c1-6a35-4cdc-8ec6-09d547fa4290 req-1da8a5fa-1f7c-442c-9cf1-bddbb6ae7cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4913f95-67d9-469c-bcf4-b05690d5f068", "name": "network-vif-plugged", "status": "completed", "tag": "b59fbfe9-d95e-4785-a682-20d6fe959e2f"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:45.725197 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-86b9b854-2303-40d6-bbd5-cb8a6896fc1e tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091596 Jun 24 08:53:45.725646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 490/1010] 10.222.0.43 () {58 vars in 1274 bytes} [Fri Jun 24 08:53:45 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:45.737099 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-335045c1-6a35-4cdc-8ec6-09d547fa4290 req-1da8a5fa-1f7c-442c-9cf1-bddbb6ae7cb9 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:45.738158 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-335045c1-6a35-4cdc-8ec6-09d547fa4290 req-1da8a5fa-1f7c-442c-9cf1-bddbb6ae7cb9 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:45.753616 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-335045c1-6a35-4cdc-8ec6-09d547fa4290 req-1da8a5fa-1f7c-442c-9cf1-bddbb6ae7cb9 service nova] Creating event network-vif-plugged:b59fbfe9-d95e-4785-a682-20d6fe959e2f for instance c4913f95-67d9-469c-bcf4-b05690d5f068 on hv-cinder-84517 Jun 24 08:53:45.758775 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-335045c1-6a35-4cdc-8ec6-09d547fa4290 req-1da8a5fa-1f7c-442c-9cf1-bddbb6ae7cb9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038684 Jun 24 08:53:45.759412 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 521/1011] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:53:46.635044 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4ee5d0f2-feb2-4437-a25c-23a972cb3266 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:46.639166 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4ee5d0f2-feb2-4437-a25c-23a972cb3266 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:46.641422 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-045e67aa-31eb-4a5b-b4c5-2040868fee94 req-68b6a569-37fd-48c2-a132-c67fedc646a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e34ef5-87e8-412a-bfd4-30e2b8918b30", "tag": "f561a1f2-cbdb-4c8d-aeec-d3853b83ccb7"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:46.646189 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ee5d0f2-feb2-4437-a25c-23a972cb3266 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:46.646715 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ee5d0f2-feb2-4437-a25c-23a972cb3266 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:46.647614 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ee5d0f2-feb2-4437-a25c-23a972cb3266 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:46.648116 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ee5d0f2-feb2-4437-a25c-23a972cb3266 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:46.649539 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-045e67aa-31eb-4a5b-b4c5-2040868fee94 req-68b6a569-37fd-48c2-a132-c67fedc646a0 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:46.649974 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-045e67aa-31eb-4a5b-b4c5-2040868fee94 req-68b6a569-37fd-48c2-a132-c67fedc646a0 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:46.661709 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-045e67aa-31eb-4a5b-b4c5-2040868fee94 req-68b6a569-37fd-48c2-a132-c67fedc646a0 service nova] Creating event network-changed:f561a1f2-cbdb-4c8d-aeec-d3853b83ccb7 for instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 on hv-cinder-84517 Jun 24 08:53:46.666507 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-045e67aa-31eb-4a5b-b4c5-2040868fee94 req-68b6a569-37fd-48c2-a132-c67fedc646a0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029678 Jun 24 08:53:46.667520 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 522/1012] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:46.779390 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4ee5d0f2-feb2-4437-a25c-23a972cb3266 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:46.787265 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4ee5d0f2-feb2-4437-a25c-23a972cb3266 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 200 len: 1362 microversion: 2.1 time: 0.156983 Jun 24 08:53:46.787835 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 491/1013] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:46 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:47.804745 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-6525aa45-3cbc-43af-a8c2-e41d8957b301 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:47.805441 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-6525aa45-3cbc-43af-a8c2-e41d8957b301 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:47.812058 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6525aa45-3cbc-43af-a8c2-e41d8957b301 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:47.812501 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6525aa45-3cbc-43af-a8c2-e41d8957b301 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:47.813303 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6525aa45-3cbc-43af-a8c2-e41d8957b301 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:47.813737 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-6525aa45-3cbc-43af-a8c2-e41d8957b301 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:47.948664 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-6525aa45-3cbc-43af-a8c2-e41d8957b301 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:47.956569 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-6525aa45-3cbc-43af-a8c2-e41d8957b301 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 200 len: 1549 microversion: 2.1 time: 0.156424 Jun 24 08:53:47.957137 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 523/1014] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:47 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:47.973221 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-81809c06-74b6-43c2-bfc0-d1b98e5f130a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:47.973705 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-81809c06-74b6-43c2-bfc0-d1b98e5f130a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:47.980165 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81809c06-74b6-43c2-bfc0-d1b98e5f130a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:47.980618 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81809c06-74b6-43c2-bfc0-d1b98e5f130a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:47.981390 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81809c06-74b6-43c2-bfc0-d1b98e5f130a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:47.981825 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-81809c06-74b6-43c2-bfc0-d1b98e5f130a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:48.029249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:48.049793 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=10 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:48.061202 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-81809c06-74b6-43c2-bfc0-d1b98e5f130a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092380 Jun 24 08:53:48.061791 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 492/1015] 10.222.0.43 () {58 vars in 1274 bytes} [Fri Jun 24 08:53:47 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:49.201487 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-352edca6-3beb-4186-8434-247d7994ed61 req-69259e72-9916-4fe7-b29b-dfbcae577559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4913f95-67d9-469c-bcf4-b05690d5f068", "tag": "b59fbfe9-d95e-4785-a682-20d6fe959e2f"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:49.205034 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=14 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:49.211191 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-352edca6-3beb-4186-8434-247d7994ed61 req-69259e72-9916-4fe7-b29b-dfbcae577559 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:49.211656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-352edca6-3beb-4186-8434-247d7994ed61 req-69259e72-9916-4fe7-b29b-dfbcae577559 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:49.374494 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-352edca6-3beb-4186-8434-247d7994ed61 req-69259e72-9916-4fe7-b29b-dfbcae577559 service nova] Creating event network-changed:b59fbfe9-d95e-4785-a682-20d6fe959e2f for instance c4913f95-67d9-469c-bcf4-b05690d5f068 on hv-cinder-84517 Jun 24 08:53:49.380112 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-352edca6-3beb-4186-8434-247d7994ed61 req-69259e72-9916-4fe7-b29b-dfbcae577559 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182234 Jun 24 08:53:49.381026 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 524/1016] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:01.575824 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:01.576560 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=71 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:01.581624 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9dfe7a0a-b527-4155-88d9-75292e8296dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:01.582120 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9dfe7a0a-b527-4155-88d9-75292e8296dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:01.589502 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dfe7a0a-b527-4155-88d9-75292e8296dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.589983 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dfe7a0a-b527-4155-88d9-75292e8296dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.590743 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dfe7a0a-b527-4155-88d9-75292e8296dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.591202 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9dfe7a0a-b527-4155-88d9-75292e8296dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.613627 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9dfe7a0a-b527-4155-88d9-75292e8296dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30/ips" status: 200 len: 150 microversion: 2.1 time: 0.039657 Jun 24 08:55:01.614190 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 493/1017] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Jun 24 08:55:01 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:01.622745 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:01.623562 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=77 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:01.628626 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-165ccca6-9098-4de2-a30d-90c74b5f0bc5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6bda097-ff31-4f4d-b2b4-38bd1b52bf71"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:55:01.629746 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-165ccca6-9098-4de2-a30d-90c74b5f0bc5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:01.637248 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-165ccca6-9098-4de2-a30d-90c74b5f0bc5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.637688 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-165ccca6-9098-4de2-a30d-90c74b5f0bc5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.638434 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-165ccca6-9098-4de2-a30d-90c74b5f0bc5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.638860 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-165ccca6-9098-4de2-a30d-90c74b5f0bc5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.715747 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-165ccca6-9098-4de2-a30d-90c74b5f0bc5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] HTTP exception thrown: Invalid volume: volume b6bda097-ff31-4f4d-b2b4-38bd1b52bf71 is already attached to instances: 5e7560a2-34d6-476c-ad87-c5b0d2279653 Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-165ccca6-9098-4de2-a30d-90c74b5f0bc5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Request method failure captured: Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: POST /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30/os-volume_attachments HTTP/1.1 Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 74 Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXsoDQD_CGiUsNKr9vstP-rG5QqwveNeZky3rqPV7DqHcIWRshL6e5u4dzLNBm7Sr4gfjZGKgL8xEQKZc1HjleqJqt3Iule2zeOJPlUoDwnxCRjlrhwAh6B2eK7ZTVPMe6699yI8A59EvBgQQbB1YTc_fZunvpgoIzZNTStObXM3P7g Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:55:01.717458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:55:01.719155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ae612a1712a404681313b8758eb4f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:55:01.719155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:55:01.719155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:55:01.719155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:55:01.719155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:55:01.719155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:55:01.719155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:55:01.719155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 8d3b1f091b4644d3b15b66eee01271c6 Jun 24 08:55:01.719155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:55:01.719155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Jun 24 08:55:01.719155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {"volumeAttachment": {"volumeId": "b6bda097-ff31-4f4d-b2b4-38bd1b52bf71"}} Jun 24 08:55:01.719155 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Invalid volume: volume b6bda097-ff31-4f4d-b2b4-38bd1b52bf71 is already attached to instances: 5e7560a2-34d6-476c-ad87-c5b0d2279653 Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'server_id': '08e34ef5-87e8-412a-bfd4-30e2b8918b30', 'body': {'volumeAttachment': {'volumeId': 'b6bda097-ff31-4f4d-b2b4-38bd1b52bf71'}}} Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b6bda097-ff31-4f4d-b2b4-38bd1b52bf71 is already attached to instances: 5e7560a2-34d6-476c-ad87-c5b0d2279653 Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:01.720701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b6bda097-ff31-4f4d-b2b4-38bd1b52bf71 is already attached to instances: 5e7560a2-34d6-476c-ad87-c5b0d2279653 Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:01.722527 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:01.724583 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:01.724583 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:55:01.724583 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:55:01.724583 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b6bda097-ff31-4f4d-b2b4-38bd1b52bf71 is already attached to instances: 5e7560a2-34d6-476c-ad87-c5b0d2279653 Jun 24 08:55:01.724583 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:01.724583 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-165ccca6-9098-4de2-a30d-90c74b5f0bc5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Returning 400 to user: Invalid volume: volume b6bda097-ff31-4f4d-b2b4-38bd1b52bf71 is already attached to instances: 5e7560a2-34d6-476c-ad87-c5b0d2279653 {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:55:01.724583 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-165ccca6-9098-4de2-a30d-90c74b5f0bc5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "POST /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098154 Jun 24 08:55:01.724583 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 525/1018] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Jun 24 08:55:01 2022] POST /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:55:01.733541 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3f28c50a-dfbd-4df6-ae8d-50d8898c9b96 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:01.734044 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3f28c50a-dfbd-4df6-ae8d-50d8898c9b96 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:01.740826 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f28c50a-dfbd-4df6-ae8d-50d8898c9b96 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.741301 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f28c50a-dfbd-4df6-ae8d-50d8898c9b96 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.742074 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f28c50a-dfbd-4df6-ae8d-50d8898c9b96 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.742502 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f28c50a-dfbd-4df6-ae8d-50d8898c9b96 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.766529 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3f28c50a-dfbd-4df6-ae8d-50d8898c9b96 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:55:01.840124 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3f28c50a-dfbd-4df6-ae8d-50d8898c9b96 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 204 len: 0 microversion: 2.1 time: 0.109858 Jun 24 08:55:01.840631 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 494/1019] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:55:01 2022] DELETE /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:55:01.850240 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-707d271e-2217-4dc0-8888-4d096b42b574 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:01.850857 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-707d271e-2217-4dc0-8888-4d096b42b574 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:01.857347 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-707d271e-2217-4dc0-8888-4d096b42b574 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.857786 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-707d271e-2217-4dc0-8888-4d096b42b574 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.858537 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-707d271e-2217-4dc0-8888-4d096b42b574 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.858963 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-707d271e-2217-4dc0-8888-4d096b42b574 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.990183 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-707d271e-2217-4dc0-8888-4d096b42b574 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:02.001910 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-707d271e-2217-4dc0-8888-4d096b42b574 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 200 len: 1682 microversion: 2.1 time: 0.156399 Jun 24 08:55:02.002468 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 526/1020] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:01 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:03.020613 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2ba63dc9-e97e-42bc-b11f-9cf232e26e9d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:03.021317 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2ba63dc9-e97e-42bc-b11f-9cf232e26e9d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:03.027811 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ba63dc9-e97e-42bc-b11f-9cf232e26e9d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:03.028283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ba63dc9-e97e-42bc-b11f-9cf232e26e9d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:03.029047 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ba63dc9-e97e-42bc-b11f-9cf232e26e9d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:03.029481 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2ba63dc9-e97e-42bc-b11f-9cf232e26e9d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:03.156015 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-2ba63dc9-e97e-42bc-b11f-9cf232e26e9d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:03.163978 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2ba63dc9-e97e-42bc-b11f-9cf232e26e9d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 200 len: 1682 microversion: 2.1 time: 0.147667 Jun 24 08:55:03.164536 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 495/1021] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:03 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:04.182405 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-14f0abb8-1f47-4d0d-b46c-1bab63278802 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:04.183097 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-14f0abb8-1f47-4d0d-b46c-1bab63278802 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:04.190557 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14f0abb8-1f47-4d0d-b46c-1bab63278802 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:04.191011 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14f0abb8-1f47-4d0d-b46c-1bab63278802 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:04.191844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14f0abb8-1f47-4d0d-b46c-1bab63278802 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:04.192279 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-14f0abb8-1f47-4d0d-b46c-1bab63278802 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:04.258181 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-14f0abb8-1f47-4d0d-b46c-1bab63278802 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:04.265800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-14f0abb8-1f47-4d0d-b46c-1bab63278802 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 200 len: 1615 microversion: 2.1 time: 0.087528 Jun 24 08:55:04.266365 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 527/1022] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:04 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:04.438336 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-7aca072a-ba4b-49ea-b592-000541e09176 req-eb117760-ad2e-4dd2-9dc7-34c145ce3a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e34ef5-87e8-412a-bfd4-30e2b8918b30", "name": "network-vif-deleted", "tag": "f561a1f2-cbdb-4c8d-aeec-d3853b83ccb7"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:55:04.450793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-7aca072a-ba4b-49ea-b592-000541e09176 req-eb117760-ad2e-4dd2-9dc7-34c145ce3a77 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:04.451259 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-7aca072a-ba4b-49ea-b592-000541e09176 req-eb117760-ad2e-4dd2-9dc7-34c145ce3a77 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:04.460960 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-25f4ea38-c29f-43c1-942b-ab829eb3c614 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:04.462137 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-25f4ea38-c29f-43c1-942b-ab829eb3c614 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:04.463189 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-7aca072a-ba4b-49ea-b592-000541e09176 req-eb117760-ad2e-4dd2-9dc7-34c145ce3a77 service nova] Creating event network-vif-deleted:f561a1f2-cbdb-4c8d-aeec-d3853b83ccb7 for instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 on hv-cinder-84517 Jun 24 08:55:04.468986 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-25f4ea38-c29f-43c1-942b-ab829eb3c614 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:04.469160 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-7aca072a-ba4b-49ea-b592-000541e09176 req-eb117760-ad2e-4dd2-9dc7-34c145ce3a77 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034486 Jun 24 08:55:04.470364 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 528/1023] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:04.470747 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-25f4ea38-c29f-43c1-942b-ab829eb3c614 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:04.472877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-25f4ea38-c29f-43c1-942b-ab829eb3c614 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:04.473761 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-25f4ea38-c29f-43c1-942b-ab829eb3c614 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:04.505110 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-25f4ea38-c29f-43c1-942b-ab829eb3c614 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/ips" status: 200 len: 146 microversion: 2.1 time: 0.200904 Jun 24 08:55:04.505990 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 496/1024] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Jun 24 08:55:04 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/ips => generated 146 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:05.283602 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f36b5225-2070-4800-9c3a-582d999b2371 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:05.284303 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f36b5225-2070-4800-9c3a-582d999b2371 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:05.290744 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f36b5225-2070-4800-9c3a-582d999b2371 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:05.291187 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f36b5225-2070-4800-9c3a-582d999b2371 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:05.291988 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f36b5225-2070-4800-9c3a-582d999b2371 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:05.292415 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-f36b5225-2070-4800-9c3a-582d999b2371 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:05.307403 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-f36b5225-2070-4800-9c3a-582d999b2371 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] HTTP exception thrown: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f36b5225-2070-4800-9c3a-582d999b2371 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Request method failure captured: Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 HTTP/1.1 Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXsoDQD_CGiUsNKr9vstP-rG5QqwveNeZky3rqPV7DqHcIWRshL6e5u4dzLNBm7Sr4gfjZGKgL8xEQKZc1HjleqJqt3Iule2zeOJPlUoDwnxCRjlrhwAh6B2eK7ZTVPMe6699yI8A59EvBgQQbB1YTc_fZunvpgoIzZNTStObXM3P7g Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:55:05.309054 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:55:05.310647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ae612a1712a404681313b8758eb4f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:55:05.310647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:55:05.310647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:55:05.310647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:55:05.310647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:55:05.310647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:55:05.310647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:55:05.310647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 8d3b1f091b4644d3b15b66eee01271c6 Jun 24 08:55:05.310647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:55:05.310647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:55:05.310647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:55:05.310647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '08e34ef5-87e8-412a-bfd4-30e2b8918b30'} Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:55:05.311796 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:55:05.313319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:05.314815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f36b5225-2070-4800-9c3a-582d999b2371 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Returning 404 to user: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:55:05.314815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f36b5225-2070-4800-9c3a-582d999b2371 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 404 len: 111 microversion: 2.1 time: 0.032248 Jun 24 08:55:05.314815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 529/1025] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:05 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:55:05.319366 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-658757f3-4eda-4808-a0d3-2720377dbfc5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '.version_select at 0x7fb75ccfe430>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:05.337105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-658757f3-4eda-4808-a0d3-2720377dbfc5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1966228831" status: 202 len: 0 microversion: 2.1 time: 0.021553 Jun 24 08:55:05.337682 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 497/1026] 10.222.0.43 () {58 vars in 1220 bytes} [Fri Jun 24 08:55:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1966228831 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:55:05.866530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bdb60386-2538-4e91-84df-2b028d8354eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df272eb2-e12f-4524-95a8-25325f300469"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:55:05.867741 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bdb60386-2538-4e91-84df-2b028d8354eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:05.874139 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bdb60386-2538-4e91-84df-2b028d8354eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:05.874519 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bdb60386-2538-4e91-84df-2b028d8354eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:05.875399 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bdb60386-2538-4e91-84df-2b028d8354eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:05.876522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bdb60386-2538-4e91-84df-2b028d8354eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:06.003910 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9ff46538-ce42-42c6-8576-1fc9c3b03b6c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:06.004461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9ff46538-ce42-42c6-8576-1fc9c3b03b6c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:06.011280 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ff46538-ce42-42c6-8576-1fc9c3b03b6c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:06.012015 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ff46538-ce42-42c6-8576-1fc9c3b03b6c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:06.012913 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ff46538-ce42-42c6-8576-1fc9c3b03b6c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:06.013427 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9ff46538-ce42-42c6-8576-1fc9c3b03b6c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:06.097671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-9ff46538-ce42-42c6-8576-1fc9c3b03b6c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lazy-loading 'services' on Instance uuid 5e7560a2-34d6-476c-ad87-c5b0d2279653 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:55:06.140274 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bdb60386-2538-4e91-84df-2b028d8354eb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "POST /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277562 Jun 24 08:55:06.140824 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 530/1027] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Jun 24 08:55:05 2022] POST /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:06.191700 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9ff46538-ce42-42c6-8576-1fc9c3b03b6c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments/b6bda097-ff31-4f4d-b2b4-38bd1b52bf71" status: 202 len: 0 microversion: 2.1 time: 0.191942 Jun 24 08:55:06.192274 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 498/1028] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Jun 24 08:55:05 2022] DELETE /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments/b6bda097-ff31-4f4d-b2b4-38bd1b52bf71 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:55:06.206494 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-eae6dbe3-67e6-49c5-ad28-a52602d10478 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:06.207647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-eae6dbe3-67e6-49c5-ad28-a52602d10478 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:06.214740 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eae6dbe3-67e6-49c5-ad28-a52602d10478 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:06.215195 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eae6dbe3-67e6-49c5-ad28-a52602d10478 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:06.216002 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eae6dbe3-67e6-49c5-ad28-a52602d10478 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:06.216439 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-eae6dbe3-67e6-49c5-ad28-a52602d10478 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:06.247076 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-eae6dbe3-67e6-49c5-ad28-a52602d10478 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046270 Jun 24 08:55:06.247662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 531/1029] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:06 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:07.260395 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c188e0ac-2b6b-4981-a66f-6cedfca10c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:07.261455 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c188e0ac-2b6b-4981-a66f-6cedfca10c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:07.269185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c188e0ac-2b6b-4981-a66f-6cedfca10c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:07.269630 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c188e0ac-2b6b-4981-a66f-6cedfca10c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:07.270385 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c188e0ac-2b6b-4981-a66f-6cedfca10c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:07.270814 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-c188e0ac-2b6b-4981-a66f-6cedfca10c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:07.299026 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c188e0ac-2b6b-4981-a66f-6cedfca10c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043140 Jun 24 08:55:07.299602 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 499/1030] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:07 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:08.310583 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-63e0bd05-28b3-458a-a3a2-bcff114a4d6a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:08.311825 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-63e0bd05-28b3-458a-a3a2-bcff114a4d6a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:08.318751 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-63e0bd05-28b3-458a-a3a2-bcff114a4d6a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:08.319324 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-63e0bd05-28b3-458a-a3a2-bcff114a4d6a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:08.320083 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-63e0bd05-28b3-458a-a3a2-bcff114a4d6a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:08.320540 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-63e0bd05-28b3-458a-a3a2-bcff114a4d6a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:08.350501 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-63e0bd05-28b3-458a-a3a2-bcff114a4d6a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044153 Jun 24 08:55:08.351063 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 532/1031] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:08 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:09.362287 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9f5bf640-be5c-4160-9778-53b3eafabb2d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:09.363286 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9f5bf640-be5c-4160-9778-53b3eafabb2d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:09.369724 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f5bf640-be5c-4160-9778-53b3eafabb2d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:09.370174 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f5bf640-be5c-4160-9778-53b3eafabb2d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:09.370939 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f5bf640-be5c-4160-9778-53b3eafabb2d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:09.371424 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f5bf640-be5c-4160-9778-53b3eafabb2d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:09.400543 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9f5bf640-be5c-4160-9778-53b3eafabb2d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042317 Jun 24 08:55:09.401091 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 500/1032] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:09 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:10.412701 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-155d9237-de05-49b7-9f87-4448d33dd888 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:10.413729 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-155d9237-de05-49b7-9f87-4448d33dd888 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:10.420367 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-155d9237-de05-49b7-9f87-4448d33dd888 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:10.420806 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-155d9237-de05-49b7-9f87-4448d33dd888 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:10.421559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-155d9237-de05-49b7-9f87-4448d33dd888 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:10.421985 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-155d9237-de05-49b7-9f87-4448d33dd888 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:10.450712 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-155d9237-de05-49b7-9f87-4448d33dd888 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042523 Jun 24 08:55:10.451184 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 533/1033] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:10 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:11.462370 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ef078efb-5e81-453e-bf9c-4a42e044961d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:11.463348 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ef078efb-5e81-453e-bf9c-4a42e044961d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:11.469498 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef078efb-5e81-453e-bf9c-4a42e044961d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:11.469943 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef078efb-5e81-453e-bf9c-4a42e044961d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:11.470691 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef078efb-5e81-453e-bf9c-4a42e044961d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:11.471126 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ef078efb-5e81-453e-bf9c-4a42e044961d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:11.498733 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ef078efb-5e81-453e-bf9c-4a42e044961d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040248 Jun 24 08:55:11.499314 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 501/1034] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:11 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:12.510069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b9da4e12-26cd-4fe4-8850-6fe165aa582f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:12.511673 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b9da4e12-26cd-4fe4-8850-6fe165aa582f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:12.519093 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b9da4e12-26cd-4fe4-8850-6fe165aa582f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:12.519584 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b9da4e12-26cd-4fe4-8850-6fe165aa582f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:12.520352 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b9da4e12-26cd-4fe4-8850-6fe165aa582f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:12.520785 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b9da4e12-26cd-4fe4-8850-6fe165aa582f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:12.551375 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b9da4e12-26cd-4fe4-8850-6fe165aa582f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044935 Jun 24 08:55:12.552721 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 534/1035] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:12 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:13.563334 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-daa6544d-073c-46a6-a690-c265132a56dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:13.564943 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-daa6544d-073c-46a6-a690-c265132a56dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:13.572021 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-daa6544d-073c-46a6-a690-c265132a56dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:13.572544 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-daa6544d-073c-46a6-a690-c265132a56dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:13.573422 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-daa6544d-073c-46a6-a690-c265132a56dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:13.573924 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-daa6544d-073c-46a6-a690-c265132a56dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:13.604860 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-daa6544d-073c-46a6-a690-c265132a56dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045862 Jun 24 08:55:13.607932 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 502/1036] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:13 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:55:13.647106 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-b4deb594-73c8-4c82-8111-57a17bb9282b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:13.648066 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-b4deb594-73c8-4c82-8111-57a17bb9282b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:13.654756 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b4deb594-73c8-4c82-8111-57a17bb9282b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:13.655230 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b4deb594-73c8-4c82-8111-57a17bb9282b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:13.656099 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b4deb594-73c8-4c82-8111-57a17bb9282b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:13.656543 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-b4deb594-73c8-4c82-8111-57a17bb9282b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:13.686175 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-b4deb594-73c8-4c82-8111-57a17bb9282b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043122 Jun 24 08:55:13.686730 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 535/1037] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:13 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:13.696608 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2abb2acb-b89f-45fe-bbde-f3bcbc827c83 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:13.697115 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-2abb2acb-b89f-45fe-bbde-f3bcbc827c83 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:13.703024 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2abb2acb-b89f-45fe-bbde-f3bcbc827c83 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:13.703520 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2abb2acb-b89f-45fe-bbde-f3bcbc827c83 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:13.704285 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2abb2acb-b89f-45fe-bbde-f3bcbc827c83 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:13.704725 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-2abb2acb-b89f-45fe-bbde-f3bcbc827c83 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:13.732600 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2abb2acb-b89f-45fe-bbde-f3bcbc827c83 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments/df272eb2-e12f-4524-95a8-25325f300469" status: 200 len: 194 microversion: 2.1 time: 0.039938 Jun 24 08:55:13.733171 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 503/1038] 10.222.0.43 () {58 vars in 1412 bytes} [Fri Jun 24 08:55:13 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments/df272eb2-e12f-4524-95a8-25325f300469 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:55:14.617342 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e3b25e2c-cf93-45a7-a2a6-bfb23e9534dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:14.618254 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e3b25e2c-cf93-45a7-a2a6-bfb23e9534dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:14.624926 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e3b25e2c-cf93-45a7-a2a6-bfb23e9534dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:14.625418 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e3b25e2c-cf93-45a7-a2a6-bfb23e9534dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:14.626331 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e3b25e2c-cf93-45a7-a2a6-bfb23e9534dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:14.626760 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e3b25e2c-cf93-45a7-a2a6-bfb23e9534dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:14.655608 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e3b25e2c-cf93-45a7-a2a6-bfb23e9534dc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042325 Jun 24 08:55:14.656241 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 536/1039] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:14 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:55:14.713249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-370f77d6-2dc1-4f34-bace-4175ca719f57 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:14.713748 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-370f77d6-2dc1-4f34-bace-4175ca719f57 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:14.720031 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-370f77d6-2dc1-4f34-bace-4175ca719f57 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:14.720484 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-370f77d6-2dc1-4f34-bace-4175ca719f57 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:14.721241 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-370f77d6-2dc1-4f34-bace-4175ca719f57 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:14.721684 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-370f77d6-2dc1-4f34-bace-4175ca719f57 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:14.746194 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-370f77d6-2dc1-4f34-bace-4175ca719f57 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:55:14.817555 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-370f77d6-2dc1-4f34-bace-4175ca719f57 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 204 len: 0 microversion: 2.1 time: 0.108052 Jun 24 08:55:14.818248 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 504/1040] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:55:14 2022] DELETE /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:55:14.826446 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-113d6bc5-854a-47f1-976b-fa15de6bdbe9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:14.827062 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-113d6bc5-854a-47f1-976b-fa15de6bdbe9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:14.833190 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-113d6bc5-854a-47f1-976b-fa15de6bdbe9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:14.833637 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-113d6bc5-854a-47f1-976b-fa15de6bdbe9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:14.834400 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-113d6bc5-854a-47f1-976b-fa15de6bdbe9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:14.834831 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-113d6bc5-854a-47f1-976b-fa15de6bdbe9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:14.964022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-113d6bc5-854a-47f1-976b-fa15de6bdbe9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:14.971904 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-113d6bc5-854a-47f1-976b-fa15de6bdbe9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 200 len: 1679 microversion: 2.1 time: 0.148763 Jun 24 08:55:14.972463 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 537/1041] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:14 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:15.036480 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f17a7c28-9a10-4c1a-850f-18d46f011ecb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34ab102c-2b66-4b6f-8814-e202fe1baa67"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:55:15.037633 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f17a7c28-9a10-4c1a-850f-18d46f011ecb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:15.043495 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f17a7c28-9a10-4c1a-850f-18d46f011ecb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:15.043949 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f17a7c28-9a10-4c1a-850f-18d46f011ecb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:15.044709 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f17a7c28-9a10-4c1a-850f-18d46f011ecb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:15.045146 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f17a7c28-9a10-4c1a-850f-18d46f011ecb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:15.989799 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-9fc0ad63-b91c-4363-b845-ac93e183b8ff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:15.990436 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-9fc0ad63-b91c-4363-b845-ac93e183b8ff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:15.997016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9fc0ad63-b91c-4363-b845-ac93e183b8ff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:15.997457 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9fc0ad63-b91c-4363-b845-ac93e183b8ff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:15.998206 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9fc0ad63-b91c-4363-b845-ac93e183b8ff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:15.998632 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-9fc0ad63-b91c-4363-b845-ac93e183b8ff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:16.130574 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-9fc0ad63-b91c-4363-b845-ac93e183b8ff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:16.145136 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-9fc0ad63-b91c-4363-b845-ac93e183b8ff tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 200 len: 1679 microversion: 2.1 time: 0.159728 Jun 24 08:55:16.145711 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 538/1042] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:15 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:16.229149 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:16.239178 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f17a7c28-9a10-4c1a-850f-18d46f011ecb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "POST /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.207437 Jun 24 08:55:16.239855 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 505/1043] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Jun 24 08:55:15 2022] POST /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments => generated 194 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:17.163471 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-90989591-6fe9-4df1-ab72-15b81f158118 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:17.164177 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-90989591-6fe9-4df1-ab72-15b81f158118 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:17.170869 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-90989591-6fe9-4df1-ab72-15b81f158118 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:17.171442 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-90989591-6fe9-4df1-ab72-15b81f158118 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:17.172253 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-90989591-6fe9-4df1-ab72-15b81f158118 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:17.172684 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-90989591-6fe9-4df1-ab72-15b81f158118 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:17.316361 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-90989591-6fe9-4df1-ab72-15b81f158118 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:17.325184 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-90989591-6fe9-4df1-ab72-15b81f158118 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 200 len: 1679 microversion: 2.1 time: 0.166281 Jun 24 08:55:17.326219 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 539/1044] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:17 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:17.656953 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-68cd8790-508e-4eec-9dba-f69967e11854 req-c1b166d5-a05b-48d4-a1c3-9b6961d3a2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7560a2-34d6-476c-ad87-c5b0d2279653", "name": "network-vif-deleted", "tag": "b5ba33be-59e9-4a60-8fca-a72c23291a91"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:55:17.669541 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-68cd8790-508e-4eec-9dba-f69967e11854 req-c1b166d5-a05b-48d4-a1c3-9b6961d3a2b8 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:17.669991 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-68cd8790-508e-4eec-9dba-f69967e11854 req-c1b166d5-a05b-48d4-a1c3-9b6961d3a2b8 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:17.684561 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-68cd8790-508e-4eec-9dba-f69967e11854 req-c1b166d5-a05b-48d4-a1c3-9b6961d3a2b8 service nova] Creating event network-vif-deleted:b5ba33be-59e9-4a60-8fca-a72c23291a91 for instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 on hv-cinder-84517 Jun 24 08:55:17.690260 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-68cd8790-508e-4eec-9dba-f69967e11854 req-c1b166d5-a05b-48d4-a1c3-9b6961d3a2b8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039833 Jun 24 08:55:17.691272 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 506/1045] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:18.341923 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8dfa8522-9d23-4ee6-b332-e946c467c2a6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:18.342735 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8dfa8522-9d23-4ee6-b332-e946c467c2a6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:18.349340 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8dfa8522-9d23-4ee6-b332-e946c467c2a6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:18.349863 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8dfa8522-9d23-4ee6-b332-e946c467c2a6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:18.350639 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8dfa8522-9d23-4ee6-b332-e946c467c2a6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:18.351080 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8dfa8522-9d23-4ee6-b332-e946c467c2a6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:18.366535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-8dfa8522-9d23-4ee6-b332-e946c467c2a6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] HTTP exception thrown: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8dfa8522-9d23-4ee6-b332-e946c467c2a6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Request method failure captured: Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 HTTP/1.1 Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXsoDQD_CGiUsNKr9vstP-rG5QqwveNeZky3rqPV7DqHcIWRshL6e5u4dzLNBm7Sr4gfjZGKgL8xEQKZc1HjleqJqt3Iule2zeOJPlUoDwnxCRjlrhwAh6B2eK7ZTVPMe6699yI8A59EvBgQQbB1YTc_fZunvpgoIzZNTStObXM3P7g Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:55:18.368323 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:55:18.369888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ae612a1712a404681313b8758eb4f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:55:18.369888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:55:18.369888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:55:18.369888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:55:18.369888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:55:18.369888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:55:18.369888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:55:18.369888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 8d3b1f091b4644d3b15b66eee01271c6 Jun 24 08:55:18.369888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:55:18.369888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:55:18.369888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:55:18.369888 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '5e7560a2-34d6-476c-ad87-c5b0d2279653'} Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:55:18.372390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:55:18.373932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:18.375069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8dfa8522-9d23-4ee6-b332-e946c467c2a6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Returning 404 to user: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:55:18.375069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8dfa8522-9d23-4ee6-b332-e946c467c2a6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 404 len: 111 microversion: 2.1 time: 0.031609 Jun 24 08:55:18.375069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 540/1046] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:18 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:55:18.380531 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ac9e79a5-f329-448f-9997-f8fdafe79f80 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '.version_select at 0x7fb75c9975e0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:18.402696 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ac9e79a5-f329-448f-9997-f8fdafe79f80 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362760192" status: 202 len: 0 microversion: 2.1 time: 0.027497 Jun 24 08:55:18.403296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 507/1047] 10.222.0.43 () {58 vars in 1217 bytes} [Fri Jun 24 08:55:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362760192 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:55:19.027196 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8f3c0bbc-5427-439b-b932-c8903f104e17 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Action: 'create', calling method: .version_select at 0x7fb75c9745e0>, body: {"keypair": {"name": "tempest-keypair-1795291590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3/ymiaIV17gg/jhEjFIZ/4MGAxZCQDuY4/lL6bpnX1I84MBsQAVf7r94ImLB3UioD5yLSBD1UBR4Z+3oUw04W5JqG8U4IpkfGA8/CO9nrFt2SVk6G2CKDbN6i8u6QHNg=="}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:55:19.041580 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-8f3c0bbc-5427-439b-b932-c8903f104e17 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for project 0ae612a1712a404681313b8758eb4f2d. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:55:19.045283 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-8f3c0bbc-5427-439b-b932-c8903f104e17 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for user 8d3b1f091b4644d3b15b66eee01271c6 and project 0ae612a1712a404681313b8758eb4f2d. Resources: {'key_pairs'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:55:19.066163 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8f3c0bbc-5427-439b-b932-c8903f104e17 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.042842 Jun 24 08:55:19.066758 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 541/1048] 10.222.0.43 () {60 vars in 1158 bytes} [Fri Jun 24 08:55:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:20.249126 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1210928495", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "088f6f07-6d3f-4c03-8832-f8bccdce4c55"}], "security_groups": [{"name": "tempest-securitygroup--1043345727"}], "key_name": "tempest-keypair-1795291590", "user_data": "}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:55:20.361329 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] validate_networks() for [('088f6f07-6d3f-4c03-8832-f8bccdce4c55', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:55:20.728629 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:55:20.729059 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:55:20.729536 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:55:20.729986 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:55:20.730397 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:55:20.739128 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:20.739610 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:20.740416 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:20.740877 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:20.757050 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for project 0ae612a1712a404681313b8758eb4f2d. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:55:20.761032 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for user 8d3b1f091b4644d3b15b66eee01271c6 and project 0ae612a1712a404681313b8758eb4f2d. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:55:20.772611 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:55:20.774901 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:55:20.821243 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f90ea98c-e05d-4f7e-a955-a2b4d5f58c64 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.576352 Jun 24 08:55:20.821884 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 508/1049] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:55:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:55:20.832390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7349ef83-3edc-4880-a4eb-aae04814dece tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:20.833013 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7349ef83-3edc-4880-a4eb-aae04814dece tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:20.891115 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7349ef83-3edc-4880-a4eb-aae04814dece tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:20.899943 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7349ef83-3edc-4880-a4eb-aae04814dece tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1242 microversion: 2.1 time: 0.071890 Jun 24 08:55:20.900520 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 542/1050] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:20 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:21.916945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3da8c56a-bdf3-4015-8bc5-8b01ce9932ac tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:21.917669 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3da8c56a-bdf3-4015-8bc5-8b01ce9932ac tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:21.926290 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3da8c56a-bdf3-4015-8bc5-8b01ce9932ac tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:21.926843 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3da8c56a-bdf3-4015-8bc5-8b01ce9932ac tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:21.927673 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3da8c56a-bdf3-4015-8bc5-8b01ce9932ac tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:21.928275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3da8c56a-bdf3-4015-8bc5-8b01ce9932ac tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:21.989344 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3da8c56a-bdf3-4015-8bc5-8b01ce9932ac tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:21.996705 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3da8c56a-bdf3-4015-8bc5-8b01ce9932ac tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1300 microversion: 2.1 time: 0.084397 Jun 24 08:55:21.997261 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 509/1051] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:21 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:23.015839 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bda6a740-f881-44e0-a71d-054b50877f03 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:23.016375 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bda6a740-f881-44e0-a71d-054b50877f03 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:23.023260 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bda6a740-f881-44e0-a71d-054b50877f03 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.023709 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bda6a740-f881-44e0-a71d-054b50877f03 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:23.024480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bda6a740-f881-44e0-a71d-054b50877f03 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.024917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bda6a740-f881-44e0-a71d-054b50877f03 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:23.159095 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bda6a740-f881-44e0-a71d-054b50877f03 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:23.172175 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bda6a740-f881-44e0-a71d-054b50877f03 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1368 microversion: 2.1 time: 0.160844 Jun 24 08:55:23.172749 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 543/1052] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:23 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:23.425006 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-3361f721-8ece-4270-8bc8-6267f9e77e23 req-f6083e90-4143-4980-9d2c-189436a9e5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87380f13-10e7-4265-92db-f929472ac1a8", "tag": "1ec99378-21a8-4824-bd1d-93c2ec4021e4"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:55:23.436147 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3361f721-8ece-4270-8bc8-6267f9e77e23 req-f6083e90-4143-4980-9d2c-189436a9e5a5 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.436982 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-3361f721-8ece-4270-8bc8-6267f9e77e23 req-f6083e90-4143-4980-9d2c-189436a9e5a5 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:23.451341 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-3361f721-8ece-4270-8bc8-6267f9e77e23 req-f6083e90-4143-4980-9d2c-189436a9e5a5 service nova] Creating event network-changed:1ec99378-21a8-4824-bd1d-93c2ec4021e4 for instance 87380f13-10e7-4265-92db-f929472ac1a8 on hv-cinder-84517 Jun 24 08:55:23.457713 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-3361f721-8ece-4270-8bc8-6267f9e77e23 req-f6083e90-4143-4980-9d2c-189436a9e5a5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036447 Jun 24 08:55:23.459377 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 510/1053] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:55:23.759660 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-656bb41e-b233-4a00-a48b-0d5f58e2be4a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:23.760594 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-656bb41e-b233-4a00-a48b-0d5f58e2be4a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:23.766558 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-656bb41e-b233-4a00-a48b-0d5f58e2be4a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.767005 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-656bb41e-b233-4a00-a48b-0d5f58e2be4a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:23.767857 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-656bb41e-b233-4a00-a48b-0d5f58e2be4a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.768288 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-656bb41e-b233-4a00-a48b-0d5f58e2be4a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:23.771964 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:23.800215 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-656bb41e-b233-4a00-a48b-0d5f58e2be4a tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044665 Jun 24 08:55:23.801029 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 544/1054] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:23 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:23.944550 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-93880d0e-6de6-4674-b218-43175233deb8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:23.945125 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-93880d0e-6de6-4674-b218-43175233deb8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:23.951307 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-93880d0e-6de6-4674-b218-43175233deb8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.951995 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-93880d0e-6de6-4674-b218-43175233deb8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:23.952791 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-93880d0e-6de6-4674-b218-43175233deb8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.953262 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-93880d0e-6de6-4674-b218-43175233deb8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:23.980825 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-93880d0e-6de6-4674-b218-43175233deb8 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments/df272eb2-e12f-4524-95a8-25325f300469" status: 200 len: 194 microversion: 2.1 time: 0.040828 Jun 24 08:55:23.981413 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 511/1055] 10.222.0.43 () {58 vars in 1412 bytes} [Fri Jun 24 08:55:23 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments/df272eb2-e12f-4524-95a8-25325f300469 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:23.991612 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c362c0b7-9293-4971-b581-0f218dbd6823 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:23.992099 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c362c0b7-9293-4971-b581-0f218dbd6823 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:23.998007 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c362c0b7-9293-4971-b581-0f218dbd6823 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.998451 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c362c0b7-9293-4971-b581-0f218dbd6823 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:23.999202 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c362c0b7-9293-4971-b581-0f218dbd6823 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.999657 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c362c0b7-9293-4971-b581-0f218dbd6823 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:24.080791 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-c362c0b7-9293-4971-b581-0f218dbd6823 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lazy-loading 'services' on Instance uuid c4913f95-67d9-469c-bcf4-b05690d5f068 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:55:24.149714 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c362c0b7-9293-4971-b581-0f218dbd6823 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments/df272eb2-e12f-4524-95a8-25325f300469" status: 202 len: 0 microversion: 2.1 time: 0.162553 Jun 24 08:55:24.150291 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 545/1056] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Jun 24 08:55:23 2022] DELETE /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments/df272eb2-e12f-4524-95a8-25325f300469 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:55:24.189891 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7b364ccc-d03e-4b28-901d-ab3126d251ef tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:24.190586 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7b364ccc-d03e-4b28-901d-ab3126d251ef tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:24.196955 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b364ccc-d03e-4b28-901d-ab3126d251ef tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:24.197464 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b364ccc-d03e-4b28-901d-ab3126d251ef tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:24.198288 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b364ccc-d03e-4b28-901d-ab3126d251ef tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:24.198802 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7b364ccc-d03e-4b28-901d-ab3126d251ef tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:24.326787 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-7b364ccc-d03e-4b28-901d-ab3126d251ef tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:24.334560 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7b364ccc-d03e-4b28-901d-ab3126d251ef tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1368 microversion: 2.1 time: 0.148666 Jun 24 08:55:24.335112 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 512/1057] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:24 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:25.353306 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a4e6c722-eaf7-4354-a874-eb8ef50944c6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:25.354058 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a4e6c722-eaf7-4354-a874-eb8ef50944c6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:25.360410 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a4e6c722-eaf7-4354-a874-eb8ef50944c6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:25.360853 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a4e6c722-eaf7-4354-a874-eb8ef50944c6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:25.361648 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a4e6c722-eaf7-4354-a874-eb8ef50944c6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:25.362585 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a4e6c722-eaf7-4354-a874-eb8ef50944c6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:25.488071 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a4e6c722-eaf7-4354-a874-eb8ef50944c6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:25.495538 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a4e6c722-eaf7-4354-a874-eb8ef50944c6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1368 microversion: 2.1 time: 0.146877 Jun 24 08:55:25.496253 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 546/1058] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:25 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:26.514082 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-960fab46-adba-48ea-8ddb-5d139f50c26c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:26.514648 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-960fab46-adba-48ea-8ddb-5d139f50c26c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:26.521543 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-960fab46-adba-48ea-8ddb-5d139f50c26c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:26.521988 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-960fab46-adba-48ea-8ddb-5d139f50c26c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:26.522739 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-960fab46-adba-48ea-8ddb-5d139f50c26c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:26.523167 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-960fab46-adba-48ea-8ddb-5d139f50c26c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:26.660511 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-960fab46-adba-48ea-8ddb-5d139f50c26c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:26.668467 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-960fab46-adba-48ea-8ddb-5d139f50c26c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1368 microversion: 2.1 time: 0.158288 Jun 24 08:55:26.672601 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 513/1059] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:26 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:27.386421 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ceb5d190-1564-47a9-8a7d-fb81314c8d7d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:27.386930 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ceb5d190-1564-47a9-8a7d-fb81314c8d7d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:27.393481 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ceb5d190-1564-47a9-8a7d-fb81314c8d7d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:27.393934 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ceb5d190-1564-47a9-8a7d-fb81314c8d7d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:27.394702 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ceb5d190-1564-47a9-8a7d-fb81314c8d7d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:27.395149 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ceb5d190-1564-47a9-8a7d-fb81314c8d7d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:27.422480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ceb5d190-1564-47a9-8a7d-fb81314c8d7d tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments/34ab102c-2b66-4b6f-8814-e202fe1baa67" status: 200 len: 194 microversion: 2.1 time: 0.040009 Jun 24 08:55:27.423036 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 547/1060] 10.222.0.43 () {58 vars in 1412 bytes} [Fri Jun 24 08:55:27 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments/34ab102c-2b66-4b6f-8814-e202fe1baa67 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:27.433231 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-cf746e21-0f1a-45b0-820d-eaa600e1bc51 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:27.433665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-cf746e21-0f1a-45b0-820d-eaa600e1bc51 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:27.440115 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf746e21-0f1a-45b0-820d-eaa600e1bc51 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:27.440575 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf746e21-0f1a-45b0-820d-eaa600e1bc51 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:27.441334 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf746e21-0f1a-45b0-820d-eaa600e1bc51 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:27.441762 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-cf746e21-0f1a-45b0-820d-eaa600e1bc51 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:27.522597 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-cf746e21-0f1a-45b0-820d-eaa600e1bc51 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lazy-loading 'services' on Instance uuid c4913f95-67d9-469c-bcf4-b05690d5f068 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:55:27.592224 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-cf746e21-0f1a-45b0-820d-eaa600e1bc51 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments/34ab102c-2b66-4b6f-8814-e202fe1baa67" status: 202 len: 0 microversion: 2.1 time: 0.162764 Jun 24 08:55:27.592830 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 514/1061] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Jun 24 08:55:27 2022] DELETE /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments/34ab102c-2b66-4b6f-8814-e202fe1baa67 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:55:27.688514 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-15ee46f2-5218-485e-82a0-e784d9738f9c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:27.689210 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-15ee46f2-5218-485e-82a0-e784d9738f9c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:27.695176 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15ee46f2-5218-485e-82a0-e784d9738f9c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:27.695658 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15ee46f2-5218-485e-82a0-e784d9738f9c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:27.696421 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15ee46f2-5218-485e-82a0-e784d9738f9c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:27.696854 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-15ee46f2-5218-485e-82a0-e784d9738f9c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:27.821711 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-15ee46f2-5218-485e-82a0-e784d9738f9c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:27.829087 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-15ee46f2-5218-485e-82a0-e784d9738f9c tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1368 microversion: 2.1 time: 0.146924 Jun 24 08:55:27.829637 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 548/1062] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:27 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:28.209020 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-1f3417f3-1894-4afc-8a5f-fa022ca3e3a0 req-89c1a793-fd25-4311-bdcf-6f1c2a6e0792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87380f13-10e7-4265-92db-f929472ac1a8", "name": "network-vif-plugged", "status": "completed", "tag": "1ec99378-21a8-4824-bd1d-93c2ec4021e4"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:55:28.218595 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-1f3417f3-1894-4afc-8a5f-fa022ca3e3a0 req-89c1a793-fd25-4311-bdcf-6f1c2a6e0792 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.219656 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-1f3417f3-1894-4afc-8a5f-fa022ca3e3a0 req-89c1a793-fd25-4311-bdcf-6f1c2a6e0792 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.231163 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-1f3417f3-1894-4afc-8a5f-fa022ca3e3a0 req-89c1a793-fd25-4311-bdcf-6f1c2a6e0792 service nova] Creating event network-vif-plugged:1ec99378-21a8-4824-bd1d-93c2ec4021e4 for instance 87380f13-10e7-4265-92db-f929472ac1a8 on hv-cinder-84517 Jun 24 08:55:28.235851 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-1f3417f3-1894-4afc-8a5f-fa022ca3e3a0 req-89c1a793-fd25-4311-bdcf-6f1c2a6e0792 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031755 Jun 24 08:55:28.236620 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 515/1063] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:28.755077 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-4b056c70-f482-4701-9c78-d93a359c1644 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:28.756109 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-4b056c70-f482-4701-9c78-d93a359c1644 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:28.762516 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4b056c70-f482-4701-9c78-d93a359c1644 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.762965 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4b056c70-f482-4701-9c78-d93a359c1644 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.763759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4b056c70-f482-4701-9c78-d93a359c1644 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.764201 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-4b056c70-f482-4701-9c78-d93a359c1644 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.792561 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-4b056c70-f482-4701-9c78-d93a359c1644 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041954 Jun 24 08:55:28.793106 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 549/1064] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:28 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:55:28.846082 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-54f231d2-1ac0-478f-88d8-61357c9a2981 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:28.846902 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-54f231d2-1ac0-478f-88d8-61357c9a2981 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:28.853646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54f231d2-1ac0-478f-88d8-61357c9a2981 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.854093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54f231d2-1ac0-478f-88d8-61357c9a2981 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.854851 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54f231d2-1ac0-478f-88d8-61357c9a2981 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.855306 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-54f231d2-1ac0-478f-88d8-61357c9a2981 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.895997 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e4012bd3-f08d-476a-8684-55506e8aa70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:28.896926 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e4012bd3-f08d-476a-8684-55506e8aa70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:28.902979 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e4012bd3-f08d-476a-8684-55506e8aa70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.903458 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e4012bd3-f08d-476a-8684-55506e8aa70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.904234 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e4012bd3-f08d-476a-8684-55506e8aa70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.904670 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-e4012bd3-f08d-476a-8684-55506e8aa70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.935515 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e4012bd3-f08d-476a-8684-55506e8aa70c tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043351 Jun 24 08:55:28.936078 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 550/1065] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:28 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:55:28.984687 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-54f231d2-1ac0-478f-88d8-61357c9a2981 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:28.992688 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-54f231d2-1ac0-478f-88d8-61357c9a2981 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1368 microversion: 2.1 time: 0.150708 Jun 24 08:55:28.993271 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 516/1066] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:28 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:28.993616 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-2b14d839-b1e2-4e24-8af6-cf0690eae49b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:28.994181 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2b14d839-b1e2-4e24-8af6-cf0690eae49b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:29.000148 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2b14d839-b1e2-4e24-8af6-cf0690eae49b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:29.000594 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2b14d839-b1e2-4e24-8af6-cf0690eae49b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:29.001345 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2b14d839-b1e2-4e24-8af6-cf0690eae49b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:29.001773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-2b14d839-b1e2-4e24-8af6-cf0690eae49b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:29.027591 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-2b14d839-b1e2-4e24-8af6-cf0690eae49b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:55:29.100104 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-2b14d839-b1e2-4e24-8af6-cf0690eae49b tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 204 len: 0 microversion: 2.1 time: 0.110263 Jun 24 08:55:29.100659 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 551/1067] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:55:28 2022] DELETE /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:55:29.108642 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b2e0608b-3b6c-49c8-8c42-1b81c9514d48 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:29.109300 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b2e0608b-3b6c-49c8-8c42-1b81c9514d48 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:29.115692 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2e0608b-3b6c-49c8-8c42-1b81c9514d48 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:29.116142 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2e0608b-3b6c-49c8-8c42-1b81c9514d48 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:29.116893 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2e0608b-3b6c-49c8-8c42-1b81c9514d48 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:29.117321 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b2e0608b-3b6c-49c8-8c42-1b81c9514d48 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:29.245125 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b2e0608b-3b6c-49c8-8c42-1b81c9514d48 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:29.253013 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b2e0608b-3b6c-49c8-8c42-1b81c9514d48 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 200 len: 1673 microversion: 2.1 time: 0.148147 Jun 24 08:55:29.253571 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 517/1068] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:29 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:30.010002 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a3b04c8a-594d-4e3d-b331-7c696c0282fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:30.010709 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a3b04c8a-594d-4e3d-b331-7c696c0282fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:30.017249 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a3b04c8a-594d-4e3d-b331-7c696c0282fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:30.017726 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a3b04c8a-594d-4e3d-b331-7c696c0282fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:30.018490 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a3b04c8a-594d-4e3d-b331-7c696c0282fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:30.018933 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a3b04c8a-594d-4e3d-b331-7c696c0282fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:30.144608 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a3b04c8a-594d-4e3d-b331-7c696c0282fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:30.151967 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a3b04c8a-594d-4e3d-b331-7c696c0282fa tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1368 microversion: 2.1 time: 0.146365 Jun 24 08:55:30.152530 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 552/1069] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:30 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:30.270558 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4ddb1099-4804-4f82-abe8-04b6c4cdc187 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:30.271101 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4ddb1099-4804-4f82-abe8-04b6c4cdc187 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:30.277645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ddb1099-4804-4f82-abe8-04b6c4cdc187 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:30.278095 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ddb1099-4804-4f82-abe8-04b6c4cdc187 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:30.278849 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ddb1099-4804-4f82-abe8-04b6c4cdc187 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:30.279312 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4ddb1099-4804-4f82-abe8-04b6c4cdc187 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:30.409899 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4ddb1099-4804-4f82-abe8-04b6c4cdc187 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:30.417517 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4ddb1099-4804-4f82-abe8-04b6c4cdc187 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 200 len: 1673 microversion: 2.1 time: 0.151327 Jun 24 08:55:30.418395 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 518/1070] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:30 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:31.170139 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-179a4e2c-78be-485d-bad5-bdfbeab8a4cc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:31.170841 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-179a4e2c-78be-485d-bad5-bdfbeab8a4cc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:31.173092 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=6 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:31.179958 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-179a4e2c-78be-485d-bad5-bdfbeab8a4cc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:31.180398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-179a4e2c-78be-485d-bad5-bdfbeab8a4cc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:31.181490 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-179a4e2c-78be-485d-bad5-bdfbeab8a4cc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:31.181595 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-179a4e2c-78be-485d-bad5-bdfbeab8a4cc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:31.305711 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-179a4e2c-78be-485d-bad5-bdfbeab8a4cc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:31.313273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-179a4e2c-78be-485d-bad5-bdfbeab8a4cc tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1559 microversion: 2.1 time: 0.148119 Jun 24 08:55:31.313831 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 553/1071] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:31 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:31.329887 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-28559036-2b22-4070-bb42-d24b08ac7d83 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:31.330443 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-28559036-2b22-4070-bb42-d24b08ac7d83 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:31.332308 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:31.332957 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:31.339062 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-28559036-2b22-4070-bb42-d24b08ac7d83 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:31.339621 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-28559036-2b22-4070-bb42-d24b08ac7d83 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:31.340407 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-28559036-2b22-4070-bb42-d24b08ac7d83 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:31.340841 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-28559036-2b22-4070-bb42-d24b08ac7d83 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:31.416054 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-28559036-2b22-4070-bb42-d24b08ac7d83 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089942 Jun 24 08:55:31.416648 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 519/1072] 10.222.0.43 () {58 vars in 1274 bytes} [Fri Jun 24 08:55:31 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:31.433698 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7485331e-e2c0-4c85-9e28-a872c39d98bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:31.434389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7485331e-e2c0-4c85-9e28-a872c39d98bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:31.440339 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7485331e-e2c0-4c85-9e28-a872c39d98bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:31.440781 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7485331e-e2c0-4c85-9e28-a872c39d98bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:31.441538 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7485331e-e2c0-4c85-9e28-a872c39d98bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:31.441967 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7485331e-e2c0-4c85-9e28-a872c39d98bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:31.702186 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7485331e-e2c0-4c85-9e28-a872c39d98bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:31.711075 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7485331e-e2c0-4c85-9e28-a872c39d98bf tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 200 len: 1673 microversion: 2.1 time: 0.281137 Jun 24 08:55:31.711889 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 554/1073] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:31 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 1673 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:32.432593 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-faf15043-d1d8-4aa3-9620-26bd8fc72915 req-cf7f2ff1-0336-4149-9124-7de1b0b1a465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87380f13-10e7-4265-92db-f929472ac1a8", "tag": "1ec99378-21a8-4824-bd1d-93c2ec4021e4"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:55:32.436298 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:32.442405 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-faf15043-d1d8-4aa3-9620-26bd8fc72915 req-cf7f2ff1-0336-4149-9124-7de1b0b1a465 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:32.442853 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-faf15043-d1d8-4aa3-9620-26bd8fc72915 req-cf7f2ff1-0336-4149-9124-7de1b0b1a465 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:32.458004 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-faf15043-d1d8-4aa3-9620-26bd8fc72915 req-cf7f2ff1-0336-4149-9124-7de1b0b1a465 service nova] Creating event network-changed:1ec99378-21a8-4824-bd1d-93c2ec4021e4 for instance 87380f13-10e7-4265-92db-f929472ac1a8 on hv-cinder-84517 Jun 24 08:55:32.464692 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-faf15043-d1d8-4aa3-9620-26bd8fc72915 req-cf7f2ff1-0336-4149-9124-7de1b0b1a465 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035874 Jun 24 08:55:32.468461 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 520/1074] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:32.511712 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-d0b02ff0-34f4-450b-a312-3a37fb042dde req-bc0febbe-93e4-4cb3-bf1b-124afa30a8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4913f95-67d9-469c-bcf4-b05690d5f068", "name": "network-vif-deleted", "tag": "b59fbfe9-d95e-4785-a682-20d6fe959e2f"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:55:32.520541 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:32.522844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-d0b02ff0-34f4-450b-a312-3a37fb042dde req-bc0febbe-93e4-4cb3-bf1b-124afa30a8a2 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:32.523576 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-d0b02ff0-34f4-450b-a312-3a37fb042dde req-bc0febbe-93e4-4cb3-bf1b-124afa30a8a2 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:32.536954 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-d0b02ff0-34f4-450b-a312-3a37fb042dde req-bc0febbe-93e4-4cb3-bf1b-124afa30a8a2 service nova] Creating event network-vif-deleted:b59fbfe9-d95e-4785-a682-20d6fe959e2f for instance c4913f95-67d9-469c-bcf4-b05690d5f068 on hv-cinder-84517 Jun 24 08:55:32.543330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-d0b02ff0-34f4-450b-a312-3a37fb042dde req-bc0febbe-93e4-4cb3-bf1b-124afa30a8a2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035188 Jun 24 08:55:32.544546 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 555/1075] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:32.729826 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b5257500-f125-4cad-85df-e6b99480e5b5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:32.731035 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-b5257500-f125-4cad-85df-e6b99480e5b5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:32.749965 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5257500-f125-4cad-85df-e6b99480e5b5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:32.750700 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5257500-f125-4cad-85df-e6b99480e5b5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:32.751888 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5257500-f125-4cad-85df-e6b99480e5b5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:32.752548 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5257500-f125-4cad-85df-e6b99480e5b5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:32.804149 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5257500-f125-4cad-85df-e6b99480e5b5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:32.804595 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-b5257500-f125-4cad-85df-e6b99480e5b5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:32.805039 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-b5257500-f125-4cad-85df-e6b99480e5b5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lazy-loading 'fault' on Instance uuid c4913f95-67d9-469c-bcf4-b05690d5f068 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:55:32.848488 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-b5257500-f125-4cad-85df-e6b99480e5b5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063272f0c2054a53b831b35abf405b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c692366d8d456ba98167614a0921f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:32.855915 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b5257500-f125-4cad-85df-e6b99480e5b5 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 200 len: 1326 microversion: 2.1 time: 0.131750 Jun 24 08:55:32.856480 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 521/1076] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:32 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 1326 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:33.874380 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c659a302-55a7-46cb-8c24-a9211be94f65 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:33.875101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c659a302-55a7-46cb-8c24-a9211be94f65 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:33.882302 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c659a302-55a7-46cb-8c24-a9211be94f65 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:33.882750 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c659a302-55a7-46cb-8c24-a9211be94f65 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:33.883545 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c659a302-55a7-46cb-8c24-a9211be94f65 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:33.883987 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c659a302-55a7-46cb-8c24-a9211be94f65 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:33.898250 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-c659a302-55a7-46cb-8c24-a9211be94f65 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] HTTP exception thrown: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c659a302-55a7-46cb-8c24-a9211be94f65 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Request method failure captured: Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 HTTP/1.1 Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXp2g7INMFAtfJAUF_1A_uKfb-a0S5yPMfSZA41X8Se2ec3QMtj33hNlx-3lswtES3y8sYnlnJZHa4yVvfT1Jw0GVKrr7iJOaUk90y7CPtITkFFOTHWQ9rHCeVZbBQk4pEaZSzYEQ1dX5agcq11hXjS3Z-a084gxZaDfRA1Kjly8cbk Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: f7c692366d8d456ba98167614a0921f0 Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:55:33.899939 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:55:33.901645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f7c692366d8d456ba98167614a0921f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:55:33.901645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:33.901645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: f7c692366d8d456ba98167614a0921f0 Jun 24 08:55:33.901645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:33.901645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeTestJSON-709227540-project Jun 24 08:55:33.901645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:55:33.901645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:55:33.901645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 063272f0c2054a53b831b35abf405b20 Jun 24 08:55:33.901645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeTestJSON-709227540-project Jun 24 08:55:33.901645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:55:33.901645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:33.901645 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': 'c4913f95-67d9-469c-bcf4-b05690d5f068'} Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:55:33.902619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:33.904356 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:33.905797 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c659a302-55a7-46cb-8c24-a9211be94f65 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Returning 404 to user: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:55:33.905797 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c659a302-55a7-46cb-8c24-a9211be94f65 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 404 len: 111 microversion: 2.1 time: 0.031869 Jun 24 08:55:33.905797 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 556/1077] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:33 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:55:33.910876 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0746d72f-775f-4101-a52f-7a84a4cb1683 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '.version_select at 0x7fb75c9fef70>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:33.928854 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0746d72f-775f-4101-a52f-7a84a4cb1683 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-985399154" status: 202 len: 0 microversion: 2.1 time: 0.022286 Jun 24 08:55:33.929436 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 522/1078] 10.222.0.43 () {58 vars in 1217 bytes} [Fri Jun 24 08:55:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-985399154 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:55:36.785574 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-943c9fc4-95d8-445a-be60-568e0262f845 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:36.786061 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-943c9fc4-95d8-445a-be60-568e0262f845 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:36.792551 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-943c9fc4-95d8-445a-be60-568e0262f845 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:36.792995 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-943c9fc4-95d8-445a-be60-568e0262f845 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:36.793739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-943c9fc4-95d8-445a-be60-568e0262f845 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:36.794167 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-943c9fc4-95d8-445a-be60-568e0262f845 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:36.808073 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-943c9fc4-95d8-445a-be60-568e0262f845 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] HTTP exception thrown: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-943c9fc4-95d8-445a-be60-568e0262f845 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Request method failure captured: Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 HTTP/1.1 Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXp2g7INMFAtfJAUF_1A_uKfb-a0S5yPMfSZA41X8Se2ec3QMtj33hNlx-3lswtES3y8sYnlnJZHa4yVvfT1Jw0GVKrr7iJOaUk90y7CPtITkFFOTHWQ9rHCeVZbBQk4pEaZSzYEQ1dX5agcq11hXjS3Z-a084gxZaDfRA1Kjly8cbk Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: f7c692366d8d456ba98167614a0921f0 Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:55:36.809577 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:55:36.811328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f7c692366d8d456ba98167614a0921f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:55:36.811328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:36.811328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: f7c692366d8d456ba98167614a0921f0 Jun 24 08:55:36.811328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:36.811328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeTestJSON-709227540-project Jun 24 08:55:36.811328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:55:36.811328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:55:36.811328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 063272f0c2054a53b831b35abf405b20 Jun 24 08:55:36.811328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeTestJSON-709227540-project Jun 24 08:55:36.811328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:55:36.811328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:36.811328 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': 'c4913f95-67d9-469c-bcf4-b05690d5f068'} Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:55:36.812417 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:36.813944 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:36.815497 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-943c9fc4-95d8-445a-be60-568e0262f845 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Returning 404 to user: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:55:36.815497 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-943c9fc4-95d8-445a-be60-568e0262f845 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 404 len: 111 microversion: 2.1 time: 0.029726 Jun 24 08:55:36.815497 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 557/1079] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:55:36 2022] DELETE /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:55:36.819921 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e7ec69ea-9f7d-4e4d-8f77-28f824145efb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:36.820573 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e7ec69ea-9f7d-4e4d-8f77-28f824145efb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: c4913f95-67d9-469c-bcf4-b05690d5f068] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:36.826654 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e7ec69ea-9f7d-4e4d-8f77-28f824145efb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:36.827103 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e7ec69ea-9f7d-4e4d-8f77-28f824145efb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:36.827892 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e7ec69ea-9f7d-4e4d-8f77-28f824145efb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:36.828329 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e7ec69ea-9f7d-4e4d-8f77-28f824145efb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:36.843275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-e7ec69ea-9f7d-4e4d-8f77-28f824145efb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] HTTP exception thrown: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e7ec69ea-9f7d-4e4d-8f77-28f824145efb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Request method failure captured: Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 HTTP/1.1 Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXp2g7INMFAtfJAUF_1A_uKfb-a0S5yPMfSZA41X8Se2ec3QMtj33hNlx-3lswtES3y8sYnlnJZHa4yVvfT1Jw0GVKrr7iJOaUk90y7CPtITkFFOTHWQ9rHCeVZbBQk4pEaZSzYEQ1dX5agcq11hXjS3Z-a084gxZaDfRA1Kjly8cbk Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: f7c692366d8d456ba98167614a0921f0 Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:55:36.844908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:55:36.847016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f7c692366d8d456ba98167614a0921f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:55:36.847016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:36.847016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: f7c692366d8d456ba98167614a0921f0 Jun 24 08:55:36.847016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:36.847016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeTestJSON-709227540-project Jun 24 08:55:36.847016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:55:36.847016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:55:36.847016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 063272f0c2054a53b831b35abf405b20 Jun 24 08:55:36.847016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeTestJSON-709227540-project Jun 24 08:55:36.847016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:55:36.847016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:36.847016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': 'c4913f95-67d9-469c-bcf4-b05690d5f068'} Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:55:36.847974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. Jun 24 08:55:36.849449 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:55:36.850757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e7ec69ea-9f7d-4e4d-8f77-28f824145efb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Returning 404 to user: Instance c4913f95-67d9-469c-bcf4-b05690d5f068 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:55:36.850757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e7ec69ea-9f7d-4e4d-8f77-28f824145efb tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068" status: 404 len: 111 microversion: 2.1 time: 0.031337 Jun 24 08:55:36.850757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 523/1080] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:36 2022] GET /compute/v2.1/servers/c4913f95-67d9-469c-bcf4-b05690d5f068 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:55:37.975938 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d5ed57a0-31a3-4e79-ad0d-0c490b74fe2f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:37.976428 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d5ed57a0-31a3-4e79-ad0d-0c490b74fe2f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:37.982875 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d5ed57a0-31a3-4e79-ad0d-0c490b74fe2f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:37.983352 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d5ed57a0-31a3-4e79-ad0d-0c490b74fe2f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:37.984103 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d5ed57a0-31a3-4e79-ad0d-0c490b74fe2f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:37.984531 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d5ed57a0-31a3-4e79-ad0d-0c490b74fe2f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:37.999996 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-d5ed57a0-31a3-4e79-ad0d-0c490b74fe2f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] HTTP exception thrown: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d5ed57a0-31a3-4e79-ad0d-0c490b74fe2f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Request method failure captured: Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 HTTP/1.1 Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXp2g7INMFAtfJAUF_1A_uKfb-a0S5yPMfSZA41X8Se2ec3QMtj33hNlx-3lswtES3y8sYnlnJZHa4yVvfT1Jw0GVKrr7iJOaUk90y7CPtITkFFOTHWQ9rHCeVZbBQk4pEaZSzYEQ1dX5agcq11hXjS3Z-a084gxZaDfRA1Kjly8cbk Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: f7c692366d8d456ba98167614a0921f0 Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:55:38.001505 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:55:38.003739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f7c692366d8d456ba98167614a0921f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:55:38.003739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:38.003739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: f7c692366d8d456ba98167614a0921f0 Jun 24 08:55:38.003739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:38.003739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeTestJSON-709227540-project Jun 24 08:55:38.003739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:55:38.003739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:55:38.003739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 063272f0c2054a53b831b35abf405b20 Jun 24 08:55:38.003739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeTestJSON-709227540-project Jun 24 08:55:38.003739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:55:38.003739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:55:38.003739 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '77cd8982-eb26-429b-ba63-c8f02412f7c3'} Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:55:38.004655 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:55:38.006208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:55:38.007836 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d5ed57a0-31a3-4e79-ad0d-0c490b74fe2f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Returning 404 to user: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:55:38.007836 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d5ed57a0-31a3-4e79-ad0d-0c490b74fe2f tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "DELETE /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 404 len: 111 microversion: 2.1 time: 0.031332 Jun 24 08:55:38.007836 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 558/1081] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:55:37 2022] DELETE /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:55:38.012743 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fa8d4d9e-5b94-40b8-b68e-44c418df34b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:38.013361 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-fa8d4d9e-5b94-40b8-b68e-44c418df34b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] [instance: 77cd8982-eb26-429b-ba63-c8f02412f7c3] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:38.019858 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa8d4d9e-5b94-40b8-b68e-44c418df34b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:38.020303 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa8d4d9e-5b94-40b8-b68e-44c418df34b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:38.021053 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa8d4d9e-5b94-40b8-b68e-44c418df34b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:38.021482 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-fa8d4d9e-5b94-40b8-b68e-44c418df34b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:38.034658 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-fa8d4d9e-5b94-40b8-b68e-44c418df34b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] HTTP exception thrown: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fa8d4d9e-5b94-40b8-b68e-44c418df34b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Request method failure captured: Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 HTTP/1.1 Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXp2g7INMFAtfJAUF_1A_uKfb-a0S5yPMfSZA41X8Se2ec3QMtj33hNlx-3lswtES3y8sYnlnJZHa4yVvfT1Jw0GVKrr7iJOaUk90y7CPtITkFFOTHWQ9rHCeVZbBQk4pEaZSzYEQ1dX5agcq11hXjS3Z-a084gxZaDfRA1Kjly8cbk Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: f7c692366d8d456ba98167614a0921f0 Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:55:38.036175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:55:38.037757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f7c692366d8d456ba98167614a0921f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f7c692366d8d456ba98167614a0921f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:55:38.037757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:38.037757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: f7c692366d8d456ba98167614a0921f0 Jun 24 08:55:38.037757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeTestJSON-709227540 Jun 24 08:55:38.037757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeTestJSON-709227540-project Jun 24 08:55:38.037757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:55:38.037757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:55:38.037757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 063272f0c2054a53b831b35abf405b20 Jun 24 08:55:38.037757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeTestJSON-709227540-project Jun 24 08:55:38.037757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:55:38.037757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:55:38.037757 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': '77cd8982-eb26-429b-ba63-c8f02412f7c3'} Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:55:38.038665 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. Jun 24 08:55:38.040185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:55:38.041579 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-fa8d4d9e-5b94-40b8-b68e-44c418df34b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] Returning 404 to user: Instance 77cd8982-eb26-429b-ba63-c8f02412f7c3 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:55:38.041579 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-fa8d4d9e-5b94-40b8-b68e-44c418df34b3 tempest-AttachVolumeTestJSON-709227540 tempest-AttachVolumeTestJSON-709227540-project] 10.222.0.43 "GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3" status: 404 len: 111 microversion: 2.1 time: 0.029747 Jun 24 08:55:38.041579 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 524/1082] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:38 2022] GET /compute/v2.1/servers/77cd8982-eb26-429b-ba63-c8f02412f7c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:56:42.736853 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:56:42.737430 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Fri Jun 24 08:56:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:56:47.761619 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=7 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:47.762377 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:47.766506 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-5f985424-36b0-4aa7-a993-fd87a2b6d427 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:47.766989 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-5f985424-36b0-4aa7-a993-fd87a2b6d427 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:47.773863 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5f985424-36b0-4aa7-a993-fd87a2b6d427 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:47.774305 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5f985424-36b0-4aa7-a993-fd87a2b6d427 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:47.775061 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5f985424-36b0-4aa7-a993-fd87a2b6d427 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:47.775515 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-5f985424-36b0-4aa7-a993-fd87a2b6d427 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:47.799367 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-5f985424-36b0-4aa7-a993-fd87a2b6d427 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/ips" status: 200 len: 151 microversion: 2.1 time: 0.039993 Jun 24 08:56:47.799912 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 559/1083] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Jun 24 08:56:47 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:50.150958 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:50.151722 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:50.156107 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ee8ebb07-a096-447f-9154-d8350f4bfd49 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "714ddb87-8a2e-48f4-b6b1-4d15869e44c9"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:56:50.157154 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ee8ebb07-a096-447f-9154-d8350f4bfd49 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:50.164378 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ee8ebb07-a096-447f-9154-d8350f4bfd49 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:50.164860 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ee8ebb07-a096-447f-9154-d8350f4bfd49 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:50.165622 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ee8ebb07-a096-447f-9154-d8350f4bfd49 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:50.166051 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ee8ebb07-a096-447f-9154-d8350f4bfd49 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:50.567600 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ee8ebb07-a096-447f-9154-d8350f4bfd49 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "POST /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418237 Jun 24 08:56:50.568292 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 525/1084] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Jun 24 08:56:50 2022] POST /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:59.193880 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-09128db1-60ce-4681-8384-f43372885307 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "714ddb87-8a2e-48f4-b6b1-4d15869e44c9"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:56:59.194962 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-09128db1-60ce-4681-8384-f43372885307 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:59.197067 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:59.198209 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:59.203729 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09128db1-60ce-4681-8384-f43372885307 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:59.204169 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09128db1-60ce-4681-8384-f43372885307 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:59.204927 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09128db1-60ce-4681-8384-f43372885307 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:59.205354 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-09128db1-60ce-4681-8384-f43372885307 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:59.334424 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-09128db1-60ce-4681-8384-f43372885307 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] HTTP exception thrown: Invalid volume: volume 714ddb87-8a2e-48f4-b6b1-4d15869e44c9 is already attached to instances: 87380f13-10e7-4265-92db-f929472ac1a8 Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-09128db1-60ce-4681-8384-f43372885307 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Request method failure captured: Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: POST /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments HTTP/1.1 Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 74 Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXsoDQD_CGiUsNKr9vstP-rG5QqwveNeZky3rqPV7DqHcIWRshL6e5u4dzLNBm7Sr4gfjZGKgL8xEQKZc1HjleqJqt3Iule2zeOJPlUoDwnxCRjlrhwAh6B2eK7ZTVPMe6699yI8A59EvBgQQbB1YTc_fZunvpgoIzZNTStObXM3P7g Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:56:59.336101 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:56:59.337805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ae612a1712a404681313b8758eb4f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:56:59.337805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:56:59.337805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:56:59.337805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:56:59.337805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:56:59.337805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:56:59.337805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:56:59.337805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 8d3b1f091b4644d3b15b66eee01271c6 Jun 24 08:56:59.337805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:56:59.337805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Jun 24 08:56:59.337805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {"volumeAttachment": {"volumeId": "714ddb87-8a2e-48f4-b6b1-4d15869e44c9"}} Jun 24 08:56:59.337805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Invalid volume: volume 714ddb87-8a2e-48f4-b6b1-4d15869e44c9 is already attached to instances: 87380f13-10e7-4265-92db-f929472ac1a8 Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'server_id': '87380f13-10e7-4265-92db-f929472ac1a8', 'body': {'volumeAttachment': {'volumeId': '714ddb87-8a2e-48f4-b6b1-4d15869e44c9'}}} Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 714ddb87-8a2e-48f4-b6b1-4d15869e44c9 is already attached to instances: 87380f13-10e7-4265-92db-f929472ac1a8 Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:56:59.338736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 714ddb87-8a2e-48f4-b6b1-4d15869e44c9 is already attached to instances: 87380f13-10e7-4265-92db-f929472ac1a8 Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:56:59.340330 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:56:59.342046 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:56:59.342046 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:56:59.342046 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:56:59.342046 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 714ddb87-8a2e-48f4-b6b1-4d15869e44c9 is already attached to instances: 87380f13-10e7-4265-92db-f929472ac1a8 Jun 24 08:56:59.342046 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:56:59.342046 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-09128db1-60ce-4681-8384-f43372885307 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Returning 400 to user: Invalid volume: volume 714ddb87-8a2e-48f4-b6b1-4d15869e44c9 is already attached to instances: 87380f13-10e7-4265-92db-f929472ac1a8 {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:56:59.342046 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-09128db1-60ce-4681-8384-f43372885307 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "POST /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.147728 Jun 24 08:56:59.342046 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 560/1085] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Jun 24 08:56:59 2022] POST /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments => generated 174 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:56:59.398708 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-dcd12c34-1a88-4564-a8d8-0bcad8191d53 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:59.399329 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-dcd12c34-1a88-4564-a8d8-0bcad8191d53 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:59.405913 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dcd12c34-1a88-4564-a8d8-0bcad8191d53 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:59.406362 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dcd12c34-1a88-4564-a8d8-0bcad8191d53 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:59.407121 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dcd12c34-1a88-4564-a8d8-0bcad8191d53 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:59.407590 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-dcd12c34-1a88-4564-a8d8-0bcad8191d53 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:59.485648 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-dcd12c34-1a88-4564-a8d8-0bcad8191d53 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lazy-loading 'services' on Instance uuid 87380f13-10e7-4265-92db-f929472ac1a8 {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:56:59.555914 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-dcd12c34-1a88-4564-a8d8-0bcad8191d53 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments/714ddb87-8a2e-48f4-b6b1-4d15869e44c9" status: 202 len: 0 microversion: 2.1 time: 0.161295 Jun 24 08:56:59.556551 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 526/1086] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Jun 24 08:56:59 2022] DELETE /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments/714ddb87-8a2e-48f4-b6b1-4d15869e44c9 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:56:59.565327 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cbf03273-d598-44e5-94a4-beae6d178b84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:59.566254 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cbf03273-d598-44e5-94a4-beae6d178b84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:59.572319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cbf03273-d598-44e5-94a4-beae6d178b84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:59.573390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cbf03273-d598-44e5-94a4-beae6d178b84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:59.574148 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cbf03273-d598-44e5-94a4-beae6d178b84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:59.574585 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cbf03273-d598-44e5-94a4-beae6d178b84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:59.603749 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cbf03273-d598-44e5-94a4-beae6d178b84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042264 Jun 24 08:56:59.604213 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 561/1087] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:59 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:00.616528 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-ba5366aa-d7a7-4f1c-9bf0-b6caf21f61b6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:00.617587 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-ba5366aa-d7a7-4f1c-9bf0-b6caf21f61b6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:00.624393 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ba5366aa-d7a7-4f1c-9bf0-b6caf21f61b6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:00.624845 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ba5366aa-d7a7-4f1c-9bf0-b6caf21f61b6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:00.625605 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ba5366aa-d7a7-4f1c-9bf0-b6caf21f61b6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:00.626040 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-ba5366aa-d7a7-4f1c-9bf0-b6caf21f61b6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:00.653844 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-ba5366aa-d7a7-4f1c-9bf0-b6caf21f61b6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042373 Jun 24 08:57:00.654388 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 527/1088] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:00 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:01.665462 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bbae35ef-23ad-449f-b60b-0393263457e6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:01.667018 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bbae35ef-23ad-449f-b60b-0393263457e6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:01.673719 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bbae35ef-23ad-449f-b60b-0393263457e6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:01.674166 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bbae35ef-23ad-449f-b60b-0393263457e6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:01.674962 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bbae35ef-23ad-449f-b60b-0393263457e6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:01.675434 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bbae35ef-23ad-449f-b60b-0393263457e6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:01.703761 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bbae35ef-23ad-449f-b60b-0393263457e6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042175 Jun 24 08:57:01.704299 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 562/1089] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:01 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:02.715297 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-7871e25b-fb7c-418f-a9ac-c610c8d34a24 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:02.716220 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-7871e25b-fb7c-418f-a9ac-c610c8d34a24 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:02.722712 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7871e25b-fb7c-418f-a9ac-c610c8d34a24 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:02.723124 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7871e25b-fb7c-418f-a9ac-c610c8d34a24 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:02.723908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7871e25b-fb7c-418f-a9ac-c610c8d34a24 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:02.724343 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-7871e25b-fb7c-418f-a9ac-c610c8d34a24 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:02.763762 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-7871e25b-fb7c-418f-a9ac-c610c8d34a24 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052129 Jun 24 08:57:02.764542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 528/1090] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:02 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:03.775296 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-fcccf86a-4711-4fc3-8956-29b13746d3e8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:03.776195 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-fcccf86a-4711-4fc3-8956-29b13746d3e8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:03.782580 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fcccf86a-4711-4fc3-8956-29b13746d3e8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:03.783022 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fcccf86a-4711-4fc3-8956-29b13746d3e8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:03.783807 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fcccf86a-4711-4fc3-8956-29b13746d3e8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:03.784235 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-fcccf86a-4711-4fc3-8956-29b13746d3e8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:03.812256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-fcccf86a-4711-4fc3-8956-29b13746d3e8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041012 Jun 24 08:57:03.812786 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 563/1091] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:03 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:57:03.868538 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9f5ba5c5-0b27-48fd-a247-8ccaac7739ea tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:03.870068 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9f5ba5c5-0b27-48fd-a247-8ccaac7739ea tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:03.876445 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f5ba5c5-0b27-48fd-a247-8ccaac7739ea tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:03.876895 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f5ba5c5-0b27-48fd-a247-8ccaac7739ea tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:03.877654 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f5ba5c5-0b27-48fd-a247-8ccaac7739ea tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:03.878103 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9f5ba5c5-0b27-48fd-a247-8ccaac7739ea tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:03.903073 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9f5ba5c5-0b27-48fd-a247-8ccaac7739ea tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:57:03.974469 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9f5ba5c5-0b27-48fd-a247-8ccaac7739ea tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 204 len: 0 microversion: 2.1 time: 0.109472 Jun 24 08:57:03.975148 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 529/1092] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:57:03 2022] DELETE /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:03.983829 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c6553dc7-5240-4063-b64f-aac17a78eba6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:03.984441 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c6553dc7-5240-4063-b64f-aac17a78eba6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:03.990364 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6553dc7-5240-4063-b64f-aac17a78eba6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:03.990808 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6553dc7-5240-4063-b64f-aac17a78eba6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:03.991595 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6553dc7-5240-4063-b64f-aac17a78eba6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:03.992033 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6553dc7-5240-4063-b64f-aac17a78eba6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:04.127774 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c6553dc7-5240-4063-b64f-aac17a78eba6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:04.135876 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c6553dc7-5240-4063-b64f-aac17a78eba6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1684 microversion: 2.1 time: 0.155190 Jun 24 08:57:04.136444 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 564/1093] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:03 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:05.154234 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3f119993-a55c-47b8-9a7a-0d1451f2d3f4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:05.154921 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3f119993-a55c-47b8-9a7a-0d1451f2d3f4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:05.161613 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f119993-a55c-47b8-9a7a-0d1451f2d3f4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:05.162093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f119993-a55c-47b8-9a7a-0d1451f2d3f4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:05.162859 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f119993-a55c-47b8-9a7a-0d1451f2d3f4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:05.163325 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3f119993-a55c-47b8-9a7a-0d1451f2d3f4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:05.292235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-3f119993-a55c-47b8-9a7a-0d1451f2d3f4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:05.299542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3f119993-a55c-47b8-9a7a-0d1451f2d3f4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1684 microversion: 2.1 time: 0.150282 Jun 24 08:57:05.300098 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 530/1094] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:05 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:06.317526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-da408c8b-67a4-44e5-9f36-d72abe7c21d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:06.318126 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-da408c8b-67a4-44e5-9f36-d72abe7c21d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:06.325265 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-da408c8b-67a4-44e5-9f36-d72abe7c21d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:06.325707 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-da408c8b-67a4-44e5-9f36-d72abe7c21d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:06.326472 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-da408c8b-67a4-44e5-9f36-d72abe7c21d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:06.326901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-da408c8b-67a4-44e5-9f36-d72abe7c21d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:06.460775 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-da408c8b-67a4-44e5-9f36-d72abe7c21d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:06.468737 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-da408c8b-67a4-44e5-9f36-d72abe7c21d9 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1684 microversion: 2.1 time: 0.155126 Jun 24 08:57:06.469291 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 565/1095] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:06 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:06.894389 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-9393857e-1ea6-46a9-a974-36e6ebf2f445 req-4f3b57a2-e911-4a94-b14e-d8b78ed978c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87380f13-10e7-4265-92db-f929472ac1a8", "name": "network-vif-deleted", "tag": "1ec99378-21a8-4824-bd1d-93c2ec4021e4"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:06.904411 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-9393857e-1ea6-46a9-a974-36e6ebf2f445 req-4f3b57a2-e911-4a94-b14e-d8b78ed978c3 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:06.904938 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-9393857e-1ea6-46a9-a974-36e6ebf2f445 req-4f3b57a2-e911-4a94-b14e-d8b78ed978c3 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:06.916042 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-9393857e-1ea6-46a9-a974-36e6ebf2f445 req-4f3b57a2-e911-4a94-b14e-d8b78ed978c3 service nova] Creating event network-vif-deleted:1ec99378-21a8-4824-bd1d-93c2ec4021e4 for instance 87380f13-10e7-4265-92db-f929472ac1a8 on hv-cinder-84517 Jun 24 08:57:06.921047 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-9393857e-1ea6-46a9-a974-36e6ebf2f445 req-4f3b57a2-e911-4a94-b14e-d8b78ed978c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030534 Jun 24 08:57:06.921704 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 531/1096] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:07.485875 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-48765e6d-9c47-4809-8c4e-9e290c25d77d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:07.486716 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-48765e6d-9c47-4809-8c4e-9e290c25d77d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:07.493489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-48765e6d-9c47-4809-8c4e-9e290c25d77d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:07.493932 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-48765e6d-9c47-4809-8c4e-9e290c25d77d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:07.495194 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-48765e6d-9c47-4809-8c4e-9e290c25d77d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:07.495643 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-48765e6d-9c47-4809-8c4e-9e290c25d77d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:07.559572 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-48765e6d-9c47-4809-8c4e-9e290c25d77d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:07.567136 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-48765e6d-9c47-4809-8c4e-9e290c25d77d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1616 microversion: 2.1 time: 0.085307 Jun 24 08:57:07.567744 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 566/1097] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:07 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1616 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:08.586452 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-442e2ec0-2407-47c1-893c-4feaf0fbe58d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:08.587422 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-442e2ec0-2407-47c1-893c-4feaf0fbe58d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:08.595862 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-442e2ec0-2407-47c1-893c-4feaf0fbe58d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:08.596727 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-442e2ec0-2407-47c1-893c-4feaf0fbe58d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:08.597681 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-442e2ec0-2407-47c1-893c-4feaf0fbe58d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:08.598119 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-442e2ec0-2407-47c1-893c-4feaf0fbe58d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:08.660402 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-442e2ec0-2407-47c1-893c-4feaf0fbe58d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:08.668570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-442e2ec0-2407-47c1-893c-4feaf0fbe58d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1327 microversion: 2.1 time: 0.086996 Jun 24 08:57:08.669349 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 532/1098] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:08 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1327 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:09.686439 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-00b7860f-2ef4-424c-8b7b-cbe6bc4ee2a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:09.687051 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-00b7860f-2ef4-424c-8b7b-cbe6bc4ee2a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:09.693580 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00b7860f-2ef4-424c-8b7b-cbe6bc4ee2a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:09.694023 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00b7860f-2ef4-424c-8b7b-cbe6bc4ee2a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:09.694777 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00b7860f-2ef4-424c-8b7b-cbe6bc4ee2a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:09.695232 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-00b7860f-2ef4-424c-8b7b-cbe6bc4ee2a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:09.758752 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-00b7860f-2ef4-424c-8b7b-cbe6bc4ee2a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:09.766242 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-00b7860f-2ef4-424c-8b7b-cbe6bc4ee2a8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 200 len: 1327 microversion: 2.1 time: 0.084270 Jun 24 08:57:09.766797 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 567/1099] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:09 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 1327 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:10.784294 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-acc3ad71-cb66-489a-aa07-3526ea258ae3 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:10.785027 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-acc3ad71-cb66-489a-aa07-3526ea258ae3 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:10.792215 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-acc3ad71-cb66-489a-aa07-3526ea258ae3 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:10.792657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-acc3ad71-cb66-489a-aa07-3526ea258ae3 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:10.793416 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-acc3ad71-cb66-489a-aa07-3526ea258ae3 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:10.793844 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-acc3ad71-cb66-489a-aa07-3526ea258ae3 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:10.806999 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-acc3ad71-cb66-489a-aa07-3526ea258ae3 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] HTTP exception thrown: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-acc3ad71-cb66-489a-aa07-3526ea258ae3 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Request method failure captured: Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 HTTP/1.1 Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXsoDQD_CGiUsNKr9vstP-rG5QqwveNeZky3rqPV7DqHcIWRshL6e5u4dzLNBm7Sr4gfjZGKgL8xEQKZc1HjleqJqt3Iule2zeOJPlUoDwnxCRjlrhwAh6B2eK7ZTVPMe6699yI8A59EvBgQQbB1YTc_fZunvpgoIzZNTStObXM3P7g Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:57:10.808657 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:57:10.810275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ae612a1712a404681313b8758eb4f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:57:10.810275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:57:10.810275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:57:10.810275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:57:10.810275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:57:10.810275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:57:10.810275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:57:10.810275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 8d3b1f091b4644d3b15b66eee01271c6 Jun 24 08:57:10.810275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:57:10.810275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:57:10.810275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:57:10.810275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': '87380f13-10e7-4265-92db-f929472ac1a8'} Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:57:10.811235 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:57:10.812801 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:57:10.814279 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-acc3ad71-cb66-489a-aa07-3526ea258ae3 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Returning 404 to user: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:57:10.814279 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-acc3ad71-cb66-489a-aa07-3526ea258ae3 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 404 len: 111 microversion: 2.1 time: 0.029601 Jun 24 08:57:10.814279 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 533/1100] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:10 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:57:10.818892 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7e52e001-acd3-4a4c-8a53-d4b7fecf5156 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '.version_select at 0x7fb75c974b80>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:10.835792 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7e52e001-acd3-4a4c-8a53-d4b7fecf5156 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795291590" status: 202 len: 0 microversion: 2.1 time: 0.020715 Jun 24 08:57:10.836274 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 568/1101] 10.222.0.43 () {58 vars in 1220 bytes} [Fri Jun 24 08:57:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795291590 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:57:11.430990 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4c819878-965c-422b-bfe4-f7926bdce9c7 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Action: 'create', calling method: .version_select at 0x7fb75ca299d0>, body: {"keypair": {"name": "tempest-keypair-507237894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeBHpZW84xVE1MDJ+w9yxL7dFn+oTt9QX3StJgUSV/JtV8k4wm0NowIKgGkEQKfIvNHNiqyK2qqe7iFfJZTTlwCVQ4egV2IOUdbGfkzQbzv4pkUy0YS300ykvvicMaZ1g=="}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:11.445102 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-4c819878-965c-422b-bfe4-f7926bdce9c7 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for project 0ae612a1712a404681313b8758eb4f2d. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:57:11.449429 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-4c819878-965c-422b-bfe4-f7926bdce9c7 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for user 8d3b1f091b4644d3b15b66eee01271c6 and project 0ae612a1712a404681313b8758eb4f2d. Resources: {'key_pairs'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:57:11.470346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4c819878-965c-422b-bfe4-f7926bdce9c7 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043204 Jun 24 08:57:11.470937 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 534/1102] 10.222.0.43 () {60 vars in 1158 bytes} [Fri Jun 24 08:57:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:12.673031 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-893582156", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "088f6f07-6d3f-4c03-8832-f8bccdce4c55"}], "security_groups": [{"name": "tempest-securitygroup--1691146898"}], "key_name": "tempest-keypair-507237894", "user_data": "}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:12.770896 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.network.neutron [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] validate_networks() for [('088f6f07-6d3f-4c03-8832-f8bccdce4c55', None, None, None, None, None)] {{(pid=124379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:57:13.118021 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Flavor limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:57:13.118444 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Image limits 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:57:13.118917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Flavor pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:57:13.119852 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Image pref 0:0:0 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:57:13.120263 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.virt.hardware [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:57:13.128908 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:13.129353 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:13.130149 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:13.130578 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:13.147834 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for project 0ae612a1712a404681313b8758eb4f2d. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:57:13.151765 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.quota [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Getting quotas for user 8d3b1f091b4644d3b15b66eee01271c6 and project 0ae612a1712a404681313b8758eb4f2d. Resources: {'cores', 'instances', 'ram'} {{(pid=124379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:57:13.162889 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Going to run 1 instances... {{(pid=124379) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:57:13.165199 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:57:13.213656 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-dd28695a-7916-4700-ad19-da26fbc4ab88 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.545333 Jun 24 08:57:13.219124 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 569/1103] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:57:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:57:13.224813 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-c00ac2dd-8007-4a12-aa5a-e5db0e212f9f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:13.225432 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-c00ac2dd-8007-4a12-aa5a-e5db0e212f9f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:13.282063 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-c00ac2dd-8007-4a12-aa5a-e5db0e212f9f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:13.288769 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-c00ac2dd-8007-4a12-aa5a-e5db0e212f9f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 200 len: 1240 microversion: 2.1 time: 0.068405 Jun 24 08:57:13.289646 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 535/1104] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:13 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:14.308646 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-d849a91e-7041-4e30-9b70-ad75aa5bfe84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:14.309779 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-d849a91e-7041-4e30-9b70-ad75aa5bfe84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:14.318112 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d849a91e-7041-4e30-9b70-ad75aa5bfe84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:14.318758 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d849a91e-7041-4e30-9b70-ad75aa5bfe84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:14.319887 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d849a91e-7041-4e30-9b70-ad75aa5bfe84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:14.320476 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-d849a91e-7041-4e30-9b70-ad75aa5bfe84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:14.396773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-d849a91e-7041-4e30-9b70-ad75aa5bfe84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:14.404318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-d849a91e-7041-4e30-9b70-ad75aa5bfe84 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 200 len: 1298 microversion: 2.1 time: 0.101270 Jun 24 08:57:14.404865 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 570/1105] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:14 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:15.422998 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-6991961f-f230-480a-af80-12d4b2997ff8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:15.424921 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-6991961f-f230-480a-af80-12d4b2997ff8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:15.437500 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6991961f-f230-480a-af80-12d4b2997ff8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:15.438773 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6991961f-f230-480a-af80-12d4b2997ff8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:15.440327 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6991961f-f230-480a-af80-12d4b2997ff8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:15.440706 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-6991961f-f230-480a-af80-12d4b2997ff8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:15.609678 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-6991961f-f230-480a-af80-12d4b2997ff8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:15.620598 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-6991961f-f230-480a-af80-12d4b2997ff8 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 200 len: 1366 microversion: 2.1 time: 0.203431 Jun 24 08:57:15.621829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 536/1106] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:15 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:15.680196 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-a2637591-3c16-4501-9506-8e5d281f229b req-b358cf1d-ec4c-4cee-9938-69e41ce9cc68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9620ced-fb2d-4c51-9714-a669cdaf0372", "tag": "56da151a-1ea1-49ac-b60c-3d17a1089a32"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:15.692607 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-a2637591-3c16-4501-9506-8e5d281f229b req-b358cf1d-ec4c-4cee-9938-69e41ce9cc68 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:15.693384 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-a2637591-3c16-4501-9506-8e5d281f229b req-b358cf1d-ec4c-4cee-9938-69e41ce9cc68 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:15.706123 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-a2637591-3c16-4501-9506-8e5d281f229b req-b358cf1d-ec4c-4cee-9938-69e41ce9cc68 service nova] Creating event network-changed:56da151a-1ea1-49ac-b60c-3d17a1089a32 for instance b9620ced-fb2d-4c51-9714-a669cdaf0372 on hv-cinder-84517 Jun 24 08:57:15.711455 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-a2637591-3c16-4501-9506-8e5d281f229b req-b358cf1d-ec4c-4cee-9938-69e41ce9cc68 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036266 Jun 24 08:57:15.712004 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 571/1107] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:16.637495 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-e353b5bf-827e-4321-89ac-54433f9171ca tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:16.638104 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-e353b5bf-827e-4321-89ac-54433f9171ca tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:16.644738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e353b5bf-827e-4321-89ac-54433f9171ca tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:16.645179 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e353b5bf-827e-4321-89ac-54433f9171ca tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:16.645937 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e353b5bf-827e-4321-89ac-54433f9171ca tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:16.646364 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-e353b5bf-827e-4321-89ac-54433f9171ca tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:16.778259 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-e353b5bf-827e-4321-89ac-54433f9171ca tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:16.785632 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-e353b5bf-827e-4321-89ac-54433f9171ca tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 200 len: 1366 microversion: 2.1 time: 0.152148 Jun 24 08:57:16.786210 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 537/1108] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:16 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:17.804037 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-852ddedc-1489-454f-89c0-9ddaa07d498f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:17.804741 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-852ddedc-1489-454f-89c0-9ddaa07d498f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:17.811799 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-852ddedc-1489-454f-89c0-9ddaa07d498f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:17.812261 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-852ddedc-1489-454f-89c0-9ddaa07d498f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:17.813032 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-852ddedc-1489-454f-89c0-9ddaa07d498f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:17.813469 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-852ddedc-1489-454f-89c0-9ddaa07d498f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:17.957814 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-852ddedc-1489-454f-89c0-9ddaa07d498f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:17.966510 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-852ddedc-1489-454f-89c0-9ddaa07d498f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 200 len: 1366 microversion: 2.1 time: 0.167546 Jun 24 08:57:17.967099 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 572/1109] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:17 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:18.985303 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d81b6ebd-d3c3-41d6-95c0-14d57090a8a4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:18.986616 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d81b6ebd-d3c3-41d6-95c0-14d57090a8a4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:18.993845 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d81b6ebd-d3c3-41d6-95c0-14d57090a8a4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:18.995305 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d81b6ebd-d3c3-41d6-95c0-14d57090a8a4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:18.996254 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d81b6ebd-d3c3-41d6-95c0-14d57090a8a4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:18.997148 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d81b6ebd-d3c3-41d6-95c0-14d57090a8a4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:19.137856 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d81b6ebd-d3c3-41d6-95c0-14d57090a8a4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:19.145269 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d81b6ebd-d3c3-41d6-95c0-14d57090a8a4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 200 len: 1366 microversion: 2.1 time: 0.165640 Jun 24 08:57:19.146017 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 538/1110] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:18 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:20.162269 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bda7e712-2d8f-4899-9b0d-c894509468b5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:20.162881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-bda7e712-2d8f-4899-9b0d-c894509468b5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:20.169445 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bda7e712-2d8f-4899-9b0d-c894509468b5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:20.169892 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bda7e712-2d8f-4899-9b0d-c894509468b5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:20.170650 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bda7e712-2d8f-4899-9b0d-c894509468b5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:20.171081 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-bda7e712-2d8f-4899-9b0d-c894509468b5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:20.301804 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-bda7e712-2d8f-4899-9b0d-c894509468b5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:20.309844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bda7e712-2d8f-4899-9b0d-c894509468b5 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 200 len: 1366 microversion: 2.1 time: 0.151590 Jun 24 08:57:20.310532 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 573/1111] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:20 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:20.353022 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-295138312", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "networks": [{"uuid": "f0450ecc-7bb2-4c67-aad5-b4e448dc5b03"}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:20.360077 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:20.404325 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] validate_networks() for [('f0450ecc-7bb2-4c67-aad5-b4e448dc5b03', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:57:20.741107 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:57:20.741557 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:57:20.742022 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:57:20.742424 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:57:20.742830 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:57:20.752195 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:20.752635 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:20.753420 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:20.753903 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:20.761551 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:20.774013 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Getting quotas for project 6fe7f78cbcdb45c8946ed1fe9171e7b1. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:57:20.779093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Getting quotas for user 60dddf53ee2647d08d2c5f3b17f34e1a and project 6fe7f78cbcdb45c8946ed1fe9171e7b1. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:57:20.790016 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-81161e3f-1dc0-43c2-9b0c-4f9109bf3860 req-49bb5eea-910d-4e07-9065-6354954279cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9620ced-fb2d-4c51-9714-a669cdaf0372", "name": "network-vif-plugged", "status": "completed", "tag": "56da151a-1ea1-49ac-b60c-3d17a1089a32"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:20.790371 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:57:20.793221 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:57:20.799086 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-81161e3f-1dc0-43c2-9b0c-4f9109bf3860 req-49bb5eea-910d-4e07-9065-6354954279cf service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:20.799531 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-81161e3f-1dc0-43c2-9b0c-4f9109bf3860 req-49bb5eea-910d-4e07-9065-6354954279cf service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:20.812143 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-81161e3f-1dc0-43c2-9b0c-4f9109bf3860 req-49bb5eea-910d-4e07-9065-6354954279cf service nova] Creating event network-vif-plugged:56da151a-1ea1-49ac-b60c-3d17a1089a32 for instance b9620ced-fb2d-4c51-9714-a669cdaf0372 on hv-cinder-84517 Jun 24 08:57:20.816893 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-81161e3f-1dc0-43c2-9b0c-4f9109bf3860 req-49bb5eea-910d-4e07-9065-6354954279cf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030600 Jun 24 08:57:20.817484 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 574/1112] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:20.842601 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-175e553a-7315-4c25-8d01-5cc8bb1892f6 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493318 Jun 24 08:57:20.848002 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 539/1113] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:57:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:57:20.854636 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-e0fdd342-cebd-4926-a80f-5058e203dc77 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:20.855526 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-e0fdd342-cebd-4926-a80f-5058e203dc77 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:20.920116 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-e0fdd342-cebd-4926-a80f-5058e203dc77 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:20.929389 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-e0fdd342-cebd-4926-a80f-5058e203dc77 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 200 len: 1218 microversion: 2.1 time: 0.079067 Jun 24 08:57:20.930784 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 575/1114] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:20 2022] GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:21.326949 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-50cee218-4c19-42c2-bdc0-d03b0ac28423 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:21.327654 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-50cee218-4c19-42c2-bdc0-d03b0ac28423 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:21.333693 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50cee218-4c19-42c2-bdc0-d03b0ac28423 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:21.334139 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50cee218-4c19-42c2-bdc0-d03b0ac28423 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:21.334895 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50cee218-4c19-42c2-bdc0-d03b0ac28423 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:21.335358 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-50cee218-4c19-42c2-bdc0-d03b0ac28423 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:21.462525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-50cee218-4c19-42c2-bdc0-d03b0ac28423 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:21.471462 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-50cee218-4c19-42c2-bdc0-d03b0ac28423 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 200 len: 1366 microversion: 2.1 time: 0.148463 Jun 24 08:57:21.472028 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 540/1115] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:21 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:21.946982 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cb5b0be8-4ff8-438a-a6fb-af8c79f7c383 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:21.948209 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cb5b0be8-4ff8-438a-a6fb-af8c79f7c383 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:21.955376 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cb5b0be8-4ff8-438a-a6fb-af8c79f7c383 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:21.955824 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cb5b0be8-4ff8-438a-a6fb-af8c79f7c383 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:21.956586 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cb5b0be8-4ff8-438a-a6fb-af8c79f7c383 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:21.957021 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cb5b0be8-4ff8-438a-a6fb-af8c79f7c383 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:22.017900 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-cb5b0be8-4ff8-438a-a6fb-af8c79f7c383 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:22.026188 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cb5b0be8-4ff8-438a-a6fb-af8c79f7c383 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 200 len: 1214 microversion: 2.1 time: 0.083014 Jun 24 08:57:22.026760 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 576/1116] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:21 2022] GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:22.488039 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-684a8a22-0701-4121-b315-1a6f08ed1cb4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:22.488582 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-684a8a22-0701-4121-b315-1a6f08ed1cb4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:22.495729 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-684a8a22-0701-4121-b315-1a6f08ed1cb4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:22.496183 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-684a8a22-0701-4121-b315-1a6f08ed1cb4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:22.496953 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-684a8a22-0701-4121-b315-1a6f08ed1cb4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:22.497391 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-684a8a22-0701-4121-b315-1a6f08ed1cb4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:22.624703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-684a8a22-0701-4121-b315-1a6f08ed1cb4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:22.632166 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-684a8a22-0701-4121-b315-1a6f08ed1cb4 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 200 len: 1556 microversion: 2.1 time: 0.148382 Jun 24 08:57:22.632724 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 541/1117] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:22 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:22.648538 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-44a0d165-6683-4be3-acf3-d2f8facbbfa6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:22.649040 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-44a0d165-6683-4be3-acf3-d2f8facbbfa6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:22.655545 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-44a0d165-6683-4be3-acf3-d2f8facbbfa6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:22.656000 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-44a0d165-6683-4be3-acf3-d2f8facbbfa6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:22.656764 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-44a0d165-6683-4be3-acf3-d2f8facbbfa6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:22.657203 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-44a0d165-6683-4be3-acf3-d2f8facbbfa6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:22.733569 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-44a0d165-6683-4be3-acf3-d2f8facbbfa6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088887 Jun 24 08:57:22.734166 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 577/1118] 10.222.0.43 () {58 vars in 1274 bytes} [Fri Jun 24 08:57:22 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:23.043945 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-a541b76d-724e-408b-b4a4-9109613b029c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:23.044564 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-a541b76d-724e-408b-b4a4-9109613b029c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:23.050469 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a541b76d-724e-408b-b4a4-9109613b029c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:23.050923 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a541b76d-724e-408b-b4a4-9109613b029c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:23.051984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a541b76d-724e-408b-b4a4-9109613b029c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:23.052412 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-a541b76d-724e-408b-b4a4-9109613b029c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:23.120705 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-a541b76d-724e-408b-b4a4-9109613b029c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:23.129323 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-a541b76d-724e-408b-b4a4-9109613b029c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 200 len: 1276 microversion: 2.1 time: 0.089937 Jun 24 08:57:23.130149 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 542/1119] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:23 2022] GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:23.987332 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:23.991404 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-9bb57a65-8539-43de-bce4-a4ca7766eec1 req-d91bf94e-dfc6-4c12-a53c-6105e0441209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9620ced-fb2d-4c51-9714-a669cdaf0372", "tag": "56da151a-1ea1-49ac-b60c-3d17a1089a32"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:24.001068 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-9bb57a65-8539-43de-bce4-a4ca7766eec1 req-d91bf94e-dfc6-4c12-a53c-6105e0441209 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:24.001522 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-9bb57a65-8539-43de-bce4-a4ca7766eec1 req-d91bf94e-dfc6-4c12-a53c-6105e0441209 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:24.013499 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-9bb57a65-8539-43de-bce4-a4ca7766eec1 req-d91bf94e-dfc6-4c12-a53c-6105e0441209 service nova] Creating event network-changed:56da151a-1ea1-49ac-b60c-3d17a1089a32 for instance b9620ced-fb2d-4c51-9714-a669cdaf0372 on hv-cinder-84517 Jun 24 08:57:24.018489 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-9bb57a65-8539-43de-bce4-a4ca7766eec1 req-d91bf94e-dfc6-4c12-a53c-6105e0441209 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032306 Jun 24 08:57:24.022603 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 578/1120] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:24.147430 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-901ba8d9-fe08-434d-83ba-1b985c52a5e8 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:24.148745 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-901ba8d9-fe08-434d-83ba-1b985c52a5e8 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:24.155652 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-901ba8d9-fe08-434d-83ba-1b985c52a5e8 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:24.156156 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-901ba8d9-fe08-434d-83ba-1b985c52a5e8 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:24.156991 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-901ba8d9-fe08-434d-83ba-1b985c52a5e8 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:24.157423 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-901ba8d9-fe08-434d-83ba-1b985c52a5e8 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:24.302519 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-901ba8d9-fe08-434d-83ba-1b985c52a5e8 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:24.311262 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-901ba8d9-fe08-434d-83ba-1b985c52a5e8 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 200 len: 1318 microversion: 2.1 time: 0.167720 Jun 24 08:57:24.311733 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 543/1121] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:24 2022] GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:24.320134 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-0d686ec2-67fb-47bb-9273-bfbfa4cb52e9 req-ce99fc50-a171-4ef1-aee9-1835d2368d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dddc76d4-a577-4878-b5bb-4839f1b530cc", "tag": "66cb6d0f-f8c8-4a22-a121-a3126a0f4ce4"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:24.334232 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0d686ec2-67fb-47bb-9273-bfbfa4cb52e9 req-ce99fc50-a171-4ef1-aee9-1835d2368d9e service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:24.334794 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-0d686ec2-67fb-47bb-9273-bfbfa4cb52e9 req-ce99fc50-a171-4ef1-aee9-1835d2368d9e service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:24.349557 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-0d686ec2-67fb-47bb-9273-bfbfa4cb52e9 req-ce99fc50-a171-4ef1-aee9-1835d2368d9e service nova] Creating event network-changed:66cb6d0f-f8c8-4a22-a121-a3126a0f4ce4 for instance dddc76d4-a577-4878-b5bb-4839f1b530cc on hv-cinder-84517 Jun 24 08:57:24.355090 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-0d686ec2-67fb-47bb-9273-bfbfa4cb52e9 req-ce99fc50-a171-4ef1-aee9-1835d2368d9e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039210 Jun 24 08:57:24.356067 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 579/1122] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:25.328229 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-91728ba1-4461-4764-b726-0f0202f325e9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:25.328869 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-91728ba1-4461-4764-b726-0f0202f325e9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:25.335148 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91728ba1-4461-4764-b726-0f0202f325e9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:25.335624 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91728ba1-4461-4764-b726-0f0202f325e9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:25.336383 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91728ba1-4461-4764-b726-0f0202f325e9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:25.336813 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-91728ba1-4461-4764-b726-0f0202f325e9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:25.464911 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-91728ba1-4461-4764-b726-0f0202f325e9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:25.472108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-91728ba1-4461-4764-b726-0f0202f325e9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 200 len: 1318 microversion: 2.1 time: 0.147759 Jun 24 08:57:25.472667 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 544/1123] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:25 2022] GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:26.489523 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7831722c-4b81-4d19-a005-7407a9f4ee30 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:26.490147 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7831722c-4b81-4d19-a005-7407a9f4ee30 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:26.497227 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7831722c-4b81-4d19-a005-7407a9f4ee30 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:26.497668 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7831722c-4b81-4d19-a005-7407a9f4ee30 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:26.498418 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7831722c-4b81-4d19-a005-7407a9f4ee30 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:26.498844 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7831722c-4b81-4d19-a005-7407a9f4ee30 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:26.623398 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-7831722c-4b81-4d19-a005-7407a9f4ee30 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:26.630644 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7831722c-4b81-4d19-a005-7407a9f4ee30 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 200 len: 1318 microversion: 2.1 time: 0.145431 Jun 24 08:57:26.631195 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 580/1124] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:26 2022] GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:27.648265 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-aa210e7d-3f7c-4794-b7db-2fa870084db1 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:27.648831 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-aa210e7d-3f7c-4794-b7db-2fa870084db1 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:27.655820 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa210e7d-3f7c-4794-b7db-2fa870084db1 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:27.656267 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa210e7d-3f7c-4794-b7db-2fa870084db1 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:27.657021 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa210e7d-3f7c-4794-b7db-2fa870084db1 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:27.657448 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa210e7d-3f7c-4794-b7db-2fa870084db1 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:27.785992 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-aa210e7d-3f7c-4794-b7db-2fa870084db1 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:27.793294 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-aa210e7d-3f7c-4794-b7db-2fa870084db1 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 200 len: 1318 microversion: 2.1 time: 0.149066 Jun 24 08:57:27.793853 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 545/1125] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:27 2022] GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:28.810362 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c466d6d3-1766-4c99-ab67-fabd5d026886 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:28.811007 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c466d6d3-1766-4c99-ab67-fabd5d026886 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:28.817435 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c466d6d3-1766-4c99-ab67-fabd5d026886 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:28.817881 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c466d6d3-1766-4c99-ab67-fabd5d026886 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:28.818647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c466d6d3-1766-4c99-ab67-fabd5d026886 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:28.819077 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c466d6d3-1766-4c99-ab67-fabd5d026886 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:28.871457 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-bbc5d8ea-2ce6-41ac-bb17-2620bdac17a5 req-d03768d6-d2a0-4bd8-be51-0551fa69bf8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddc76d4-a577-4878-b5bb-4839f1b530cc", "name": "network-vif-plugged", "status": "completed", "tag": "66cb6d0f-f8c8-4a22-a121-a3126a0f4ce4"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:28.880403 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-bbc5d8ea-2ce6-41ac-bb17-2620bdac17a5 req-d03768d6-d2a0-4bd8-be51-0551fa69bf8e service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:28.881124 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-bbc5d8ea-2ce6-41ac-bb17-2620bdac17a5 req-d03768d6-d2a0-4bd8-be51-0551fa69bf8e service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:28.892654 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-bbc5d8ea-2ce6-41ac-bb17-2620bdac17a5 req-d03768d6-d2a0-4bd8-be51-0551fa69bf8e service nova] Creating event network-vif-plugged:66cb6d0f-f8c8-4a22-a121-a3126a0f4ce4 for instance dddc76d4-a577-4878-b5bb-4839f1b530cc on hv-cinder-84517 Jun 24 08:57:28.897968 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-bbc5d8ea-2ce6-41ac-bb17-2620bdac17a5 req-d03768d6-d2a0-4bd8-be51-0551fa69bf8e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030401 Jun 24 08:57:28.898427 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 546/1126] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:28.952836 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c466d6d3-1766-4c99-ab67-fabd5d026886 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:28.961831 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c466d6d3-1766-4c99-ab67-fabd5d026886 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 200 len: 1318 microversion: 2.1 time: 0.155338 Jun 24 08:57:28.962415 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 581/1127] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:28 2022] GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:29.981259 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-00d5075a-2950-448f-8b9d-d2b512099535 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:29.981952 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-00d5075a-2950-448f-8b9d-d2b512099535 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:29.988113 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00d5075a-2950-448f-8b9d-d2b512099535 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:29.988559 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00d5075a-2950-448f-8b9d-d2b512099535 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:29.989311 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00d5075a-2950-448f-8b9d-d2b512099535 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:29.989738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-00d5075a-2950-448f-8b9d-d2b512099535 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:30.117852 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-00d5075a-2950-448f-8b9d-d2b512099535 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:30.125139 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-00d5075a-2950-448f-8b9d-d2b512099535 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 200 len: 1318 microversion: 2.1 time: 0.149041 Jun 24 08:57:30.125701 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 547/1128] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:29 2022] GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:31.141385 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c3b6f0cb-2ba1-4938-bd9c-6be2a732df8d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:31.142002 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c3b6f0cb-2ba1-4938-bd9c-6be2a732df8d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:31.144436 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=8 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:31.145148 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:31.150923 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c3b6f0cb-2ba1-4938-bd9c-6be2a732df8d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:31.151475 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c3b6f0cb-2ba1-4938-bd9c-6be2a732df8d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:31.152242 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c3b6f0cb-2ba1-4938-bd9c-6be2a732df8d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:31.152677 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c3b6f0cb-2ba1-4938-bd9c-6be2a732df8d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:31.157437 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=99 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:31.286901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c3b6f0cb-2ba1-4938-bd9c-6be2a732df8d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:31.294815 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c3b6f0cb-2ba1-4938-bd9c-6be2a732df8d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 200 len: 1508 microversion: 2.1 time: 0.157285 Jun 24 08:57:31.295414 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 582/1129] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:31 2022] GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:51.621102 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-975be0ee-f8a8-4b64-9d6e-24d46296904a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b56fa382-267f-4b5b-a22a-af723b03b5bc", "device": "/dev/sdb"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:51.622702 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-975be0ee-f8a8-4b64-9d6e-24d46296904a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:51.624662 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:51.625346 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=12 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:51.626151 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:51.626796 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=45 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:51.633931 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-975be0ee-f8a8-4b64-9d6e-24d46296904a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:51.634381 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-975be0ee-f8a8-4b64-9d6e-24d46296904a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:51.635144 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-975be0ee-f8a8-4b64-9d6e-24d46296904a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:51.635605 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-975be0ee-f8a8-4b64-9d6e-24d46296904a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:51.883593 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-975be0ee-f8a8-4b64-9d6e-24d46296904a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "POST /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267020 Jun 24 08:57:51.884252 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 548/1130] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Jun 24 08:57:51 2022] POST /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:58:18.628982 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-65c25fb2-4e7b-45f7-8df2-4419bfd09f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:18.629509 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-65c25fb2-4e7b-45f7-8df2-4419bfd09f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:18.631493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:18.632140 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=5 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:18.638704 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-65c25fb2-4e7b-45f7-8df2-4419bfd09f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:18.639160 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-65c25fb2-4e7b-45f7-8df2-4419bfd09f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:18.639960 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-65c25fb2-4e7b-45f7-8df2-4419bfd09f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:18.640403 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-65c25fb2-4e7b-45f7-8df2-4419bfd09f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:18.723186 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-65c25fb2-4e7b-45f7-8df2-4419bfd09f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lazy-loading 'services' on Instance uuid dddc76d4-a577-4878-b5bb-4839f1b530cc {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:58:18.795335 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-65c25fb2-4e7b-45f7-8df2-4419bfd09f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc/os-volume_attachments/b56fa382-267f-4b5b-a22a-af723b03b5bc" status: 202 len: 0 microversion: 2.1 time: 0.170224 Jun 24 08:58:18.795926 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 583/1131] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Jun 24 08:58:18 2022] DELETE /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc/os-volume_attachments/b56fa382-267f-4b5b-a22a-af723b03b5bc => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:58:19.906420 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:19.907185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:19.911631 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9a727dba-be78-45e7-937d-002dc80c4700 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:19.912220 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9a727dba-be78-45e7-937d-002dc80c4700 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:19.920184 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a727dba-be78-45e7-937d-002dc80c4700 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:19.920640 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a727dba-be78-45e7-937d-002dc80c4700 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:19.921432 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a727dba-be78-45e7-937d-002dc80c4700 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:19.921870 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9a727dba-be78-45e7-937d-002dc80c4700 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:19.948422 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9a727dba-be78-45e7-937d-002dc80c4700 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:58:20.026067 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9a727dba-be78-45e7-937d-002dc80c4700 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "DELETE /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 204 len: 0 microversion: 2.1 time: 0.120766 Jun 24 08:58:20.026951 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 549/1132] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:58:19 2022] DELETE /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:58:20.036390 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-c6b5033b-c036-4400-b911-7e452ca276e0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:20.037128 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-c6b5033b-c036-4400-b911-7e452ca276e0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:20.044548 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6b5033b-c036-4400-b911-7e452ca276e0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:20.044999 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6b5033b-c036-4400-b911-7e452ca276e0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:20.045769 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6b5033b-c036-4400-b911-7e452ca276e0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:20.046208 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-c6b5033b-c036-4400-b911-7e452ca276e0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:20.179198 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-c6b5033b-c036-4400-b911-7e452ca276e0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:20.187441 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-c6b5033b-c036-4400-b911-7e452ca276e0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 200 len: 1514 microversion: 2.1 time: 0.155232 Jun 24 08:58:20.188009 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 584/1133] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:20 2022] GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:21.204643 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-d3602c75-d7a8-4d48-832c-dedac868e766 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:21.205373 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-d3602c75-d7a8-4d48-832c-dedac868e766 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:21.212022 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d3602c75-d7a8-4d48-832c-dedac868e766 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:21.212474 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d3602c75-d7a8-4d48-832c-dedac868e766 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:21.213238 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d3602c75-d7a8-4d48-832c-dedac868e766 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:21.213674 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-d3602c75-d7a8-4d48-832c-dedac868e766 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:21.346699 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-d3602c75-d7a8-4d48-832c-dedac868e766 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:21.355391 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-d3602c75-d7a8-4d48-832c-dedac868e766 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 200 len: 1514 microversion: 2.1 time: 0.154903 Jun 24 08:58:21.355983 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 550/1134] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:21 2022] GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:22.372653 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8d098b46-0595-4ec2-99b6-bae9286119f7 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:22.373262 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8d098b46-0595-4ec2-99b6-bae9286119f7 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:22.380034 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d098b46-0595-4ec2-99b6-bae9286119f7 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:22.380480 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d098b46-0595-4ec2-99b6-bae9286119f7 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:22.381248 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d098b46-0595-4ec2-99b6-bae9286119f7 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:22.381686 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8d098b46-0595-4ec2-99b6-bae9286119f7 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:22.515151 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-8d098b46-0595-4ec2-99b6-bae9286119f7 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:22.523116 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8d098b46-0595-4ec2-99b6-bae9286119f7 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 200 len: 1514 microversion: 2.1 time: 0.154273 Jun 24 08:58:22.533224 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 585/1135] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:22 2022] GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:22.720025 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-4f7a1982-3078-4ebe-8686-48f78cb5ac74 req-1efa7993-676d-48b6-96f8-7c151c5dd01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddc76d4-a577-4878-b5bb-4839f1b530cc", "name": "network-vif-deleted", "tag": "66cb6d0f-f8c8-4a22-a121-a3126a0f4ce4"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:58:22.728783 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-4f7a1982-3078-4ebe-8686-48f78cb5ac74 req-1efa7993-676d-48b6-96f8-7c151c5dd01f service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:22.729233 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-4f7a1982-3078-4ebe-8686-48f78cb5ac74 req-1efa7993-676d-48b6-96f8-7c151c5dd01f service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:22.740738 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-4f7a1982-3078-4ebe-8686-48f78cb5ac74 req-1efa7993-676d-48b6-96f8-7c151c5dd01f service nova] Creating event network-vif-deleted:66cb6d0f-f8c8-4a22-a121-a3126a0f4ce4 for instance dddc76d4-a577-4878-b5bb-4839f1b530cc on hv-cinder-84517 Jun 24 08:58:22.746093 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-4f7a1982-3078-4ebe-8686-48f78cb5ac74 req-1efa7993-676d-48b6-96f8-7c151c5dd01f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151699 Jun 24 08:58:22.746684 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 551/1136] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:58:23.540471 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-32658cdb-3bb5-4f71-a63d-3378a390aced tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:23.541258 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-32658cdb-3bb5-4f71-a63d-3378a390aced tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: dddc76d4-a577-4878-b5bb-4839f1b530cc] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:23.547557 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32658cdb-3bb5-4f71-a63d-3378a390aced tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:23.548000 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32658cdb-3bb5-4f71-a63d-3378a390aced tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:23.548757 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32658cdb-3bb5-4f71-a63d-3378a390aced tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:23.549186 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-32658cdb-3bb5-4f71-a63d-3378a390aced tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:23.563631 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-32658cdb-3bb5-4f71-a63d-3378a390aced tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] HTTP exception thrown: Instance dddc76d4-a577-4878-b5bb-4839f1b530cc could not be found. Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-32658cdb-3bb5-4f71-a63d-3378a390aced tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Request method failure captured: Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc HTTP/1.1 Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXxu3fUDrAMcOij21S_w3_dYkBYrDuHISmydNkFg1lYRlkIlHpPf4EPnUGK6Yd7P5llJ1yFcS0avDYRGKD1Ys80ptNA49gdCkiSrFYOVVd3TNYhMxwqb1xWg8-Yc8Rwg4LlKB1csBer8wzm2YWxSMyMvHfpfbjxqdGuN79U7zn5N4OY Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 6fe7f78cbcdb45c8946ed1fe9171e7b1 Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1620984354 Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:58:23.566318 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:58:23.568069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6fe7f78cbcdb45c8946ed1fe9171e7b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6fe7f78cbcdb45c8946ed1fe9171e7b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6fe7f78cbcdb45c8946ed1fe9171e7b1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6fe7f78cbcdb45c8946ed1fe9171e7b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:58:23.568069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesSnapshotTestJSON-1620984354 Jun 24 08:58:23.568069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 6fe7f78cbcdb45c8946ed1fe9171e7b1 Jun 24 08:58:23.568069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1620984354 Jun 24 08:58:23.568069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesSnapshotTestJSON-1620984354-project Jun 24 08:58:23.568069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:58:23.568069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:58:23.568069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 60dddf53ee2647d08d2c5f3b17f34e1a Jun 24 08:58:23.568069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesSnapshotTestJSON-1620984354-project Jun 24 08:58:23.568069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:58:23.568069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance dddc76d4-a577-4878-b5bb-4839f1b530cc could not be found. Jun 24 08:58:23.568069 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': 'dddc76d4-a577-4878-b5bb-4839f1b530cc'} Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dddc76d4-a577-4878-b5bb-4839f1b530cc could not be found. Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:58:23.569074 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dddc76d4-a577-4878-b5bb-4839f1b530cc could not be found. Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dddc76d4-a577-4878-b5bb-4839f1b530cc could not be found. Jun 24 08:58:23.571493 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:58:23.572902 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-32658cdb-3bb5-4f71-a63d-3378a390aced tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Returning 404 to user: Instance dddc76d4-a577-4878-b5bb-4839f1b530cc could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:58:23.572902 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-32658cdb-3bb5-4f71-a63d-3378a390aced tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc" status: 404 len: 111 microversion: 2.1 time: 0.031826 Jun 24 08:58:23.572902 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 586/1137] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:23 2022] GET /compute/v2.1/servers/dddc76d4-a577-4878-b5bb-4839f1b530cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:58:33.386418 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:33.387273 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:33.391837 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1705927136", "imageRef": "ca816a3e-8334-4fd4-95ce-66e971ac4f86", "flavorRef": "452", "networks": [{"uuid": "f0450ecc-7bb2-4c67-aad5-b4e448dc5b03"}]}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:58:33.455003 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.network.neutron [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] validate_networks() for [('f0450ecc-7bb2-4c67-aad5-b4e448dc5b03', None, None, None, None, None)] {{(pid=124380) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:58:33.808283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Flavor limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:58:33.808703 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Image limits 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:58:33.809170 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Flavor pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:58:33.809575 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Image pref 0:0:0 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:58:33.809979 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.virt.hardware [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124380) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:58:33.819149 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:33.819612 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:33.820398 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:33.820828 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:33.837264 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Getting quotas for project 6fe7f78cbcdb45c8946ed1fe9171e7b1. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:58:33.841238 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.quota [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Getting quotas for user 60dddf53ee2647d08d2c5f3b17f34e1a and project 6fe7f78cbcdb45c8946ed1fe9171e7b1. Resources: {'cores', 'instances', 'ram'} {{(pid=124380) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:58:33.853861 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Going to run 1 instances... {{(pid=124380) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:58:33.856216 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ca816a3e-8334-4fd4-95ce-66e971ac4f86',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124380) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:58:33.900749 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1506a180-2927-4689-a9e1-b2dfcbf7666b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515754 Jun 24 08:58:33.901391 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 552/1138] 10.222.0.43 () {60 vars in 1146 bytes} [Fri Jun 24 08:58:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:58:33.911496 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-f38dae8d-8dea-44f0-8985-6d3a9c84ce45 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:33.912128 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-f38dae8d-8dea-44f0-8985-6d3a9c84ce45 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:33.915406 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=8 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:33.916830 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:33.970370 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-f38dae8d-8dea-44f0-8985-6d3a9c84ce45 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:33.978201 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-f38dae8d-8dea-44f0-8985-6d3a9c84ce45 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 200 len: 1219 microversion: 2.1 time: 0.070622 Jun 24 08:58:33.978771 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 587/1139] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:33 2022] GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:34.995540 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-44f19ab5-c0d0-466f-88f5-47001efda8f0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:34.996255 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-44f19ab5-c0d0-466f-88f5-47001efda8f0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:35.002683 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44f19ab5-c0d0-466f-88f5-47001efda8f0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:35.003248 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44f19ab5-c0d0-466f-88f5-47001efda8f0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:35.004095 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44f19ab5-c0d0-466f-88f5-47001efda8f0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:35.004639 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-44f19ab5-c0d0-466f-88f5-47001efda8f0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:35.072105 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-44f19ab5-c0d0-466f-88f5-47001efda8f0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:35.083349 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-44f19ab5-c0d0-466f-88f5-47001efda8f0 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 200 len: 1279 microversion: 2.1 time: 0.090475 Jun 24 08:58:35.084511 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 553/1140] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:34 2022] GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 1279 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:36.102740 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-69403d67-1fc1-4e9e-80a2-6f05330fc501 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:36.103391 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-69403d67-1fc1-4e9e-80a2-6f05330fc501 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:36.110744 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69403d67-1fc1-4e9e-80a2-6f05330fc501 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:36.111320 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69403d67-1fc1-4e9e-80a2-6f05330fc501 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:36.112033 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69403d67-1fc1-4e9e-80a2-6f05330fc501 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:36.112572 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-69403d67-1fc1-4e9e-80a2-6f05330fc501 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:36.243258 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-69403d67-1fc1-4e9e-80a2-6f05330fc501 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:36.251246 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-69403d67-1fc1-4e9e-80a2-6f05330fc501 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 200 len: 1319 microversion: 2.1 time: 0.153242 Jun 24 08:58:36.251946 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 588/1141] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:36 2022] GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:36.369338 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-783bf12f-bc3b-4938-a7e8-91005a26e759 req-220343f9-e2ef-4018-9d2c-e02b3feec31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36ffcf2a-9435-48ae-b9da-01316510df4a", "tag": "07688bfe-bc5e-4fb9-9f3a-0572410ee17b"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:58:36.385267 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-783bf12f-bc3b-4938-a7e8-91005a26e759 req-220343f9-e2ef-4018-9d2c-e02b3feec31f service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:36.386338 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-783bf12f-bc3b-4938-a7e8-91005a26e759 req-220343f9-e2ef-4018-9d2c-e02b3feec31f service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:36.401012 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-783bf12f-bc3b-4938-a7e8-91005a26e759 req-220343f9-e2ef-4018-9d2c-e02b3feec31f service nova] Creating event network-changed:07688bfe-bc5e-4fb9-9f3a-0572410ee17b for instance 36ffcf2a-9435-48ae-b9da-01316510df4a on hv-cinder-84517 Jun 24 08:58:36.405947 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-783bf12f-bc3b-4938-a7e8-91005a26e759 req-220343f9-e2ef-4018-9d2c-e02b3feec31f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041178 Jun 24 08:58:36.406536 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 554/1142] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:58:37.268455 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-25527876-6850-46db-ab1a-42f67d1c992b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:37.269073 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-25527876-6850-46db-ab1a-42f67d1c992b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:37.275627 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25527876-6850-46db-ab1a-42f67d1c992b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:37.276082 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25527876-6850-46db-ab1a-42f67d1c992b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:37.276846 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25527876-6850-46db-ab1a-42f67d1c992b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:37.277289 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-25527876-6850-46db-ab1a-42f67d1c992b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:37.405015 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-25527876-6850-46db-ab1a-42f67d1c992b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:37.412436 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-25527876-6850-46db-ab1a-42f67d1c992b tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 200 len: 1319 microversion: 2.1 time: 0.147895 Jun 24 08:58:37.412997 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 589/1143] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:37 2022] GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:38.431687 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-1736dc3e-c37b-4537-b6f8-f38fd6568b9d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:38.432297 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-1736dc3e-c37b-4537-b6f8-f38fd6568b9d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:38.438658 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1736dc3e-c37b-4537-b6f8-f38fd6568b9d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:38.439099 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1736dc3e-c37b-4537-b6f8-f38fd6568b9d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:38.439883 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1736dc3e-c37b-4537-b6f8-f38fd6568b9d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:38.440320 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-1736dc3e-c37b-4537-b6f8-f38fd6568b9d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:38.572686 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-1736dc3e-c37b-4537-b6f8-f38fd6568b9d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:38.580142 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-1736dc3e-c37b-4537-b6f8-f38fd6568b9d tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 200 len: 1319 microversion: 2.1 time: 0.154001 Jun 24 08:58:38.580697 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 555/1144] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:38 2022] GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:39.596957 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0da59bdd-5446-4754-9d98-c0932a60d9da tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:39.597567 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-0da59bdd-5446-4754-9d98-c0932a60d9da tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:39.604083 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0da59bdd-5446-4754-9d98-c0932a60d9da tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:39.604528 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0da59bdd-5446-4754-9d98-c0932a60d9da tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:39.605290 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0da59bdd-5446-4754-9d98-c0932a60d9da tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:39.605723 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-0da59bdd-5446-4754-9d98-c0932a60d9da tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:39.737005 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-0da59bdd-5446-4754-9d98-c0932a60d9da tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:39.745179 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0da59bdd-5446-4754-9d98-c0932a60d9da tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 200 len: 1319 microversion: 2.1 time: 0.152069 Jun 24 08:58:39.745745 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 590/1145] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:39 2022] GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:40.762904 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f17e2712-b60e-48b3-9f07-6cfb38f29c20 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:40.763537 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f17e2712-b60e-48b3-9f07-6cfb38f29c20 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:40.770234 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f17e2712-b60e-48b3-9f07-6cfb38f29c20 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:40.770685 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f17e2712-b60e-48b3-9f07-6cfb38f29c20 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:40.771483 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f17e2712-b60e-48b3-9f07-6cfb38f29c20 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:40.771929 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f17e2712-b60e-48b3-9f07-6cfb38f29c20 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:40.921658 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-f17e2712-b60e-48b3-9f07-6cfb38f29c20 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:40.930710 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f17e2712-b60e-48b3-9f07-6cfb38f29c20 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 200 len: 1319 microversion: 2.1 time: 0.171857 Jun 24 08:58:40.931321 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 556/1146] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:40 2022] GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:41.636456 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-f7f86c69-3e85-40e5-b735-1d7c685c04c5 req-3f63a3f2-4f17-4b88-89c0-b175614fb870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36ffcf2a-9435-48ae-b9da-01316510df4a", "name": "network-vif-plugged", "status": "completed", "tag": "07688bfe-bc5e-4fb9-9f3a-0572410ee17b"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:58:41.645718 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-f7f86c69-3e85-40e5-b735-1d7c685c04c5 req-3f63a3f2-4f17-4b88-89c0-b175614fb870 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:41.646174 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-f7f86c69-3e85-40e5-b735-1d7c685c04c5 req-3f63a3f2-4f17-4b88-89c0-b175614fb870 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:41.662557 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-f7f86c69-3e85-40e5-b735-1d7c685c04c5 req-3f63a3f2-4f17-4b88-89c0-b175614fb870 service nova] Creating event network-vif-plugged:07688bfe-bc5e-4fb9-9f3a-0572410ee17b for instance 36ffcf2a-9435-48ae-b9da-01316510df4a on hv-cinder-84517 Jun 24 08:58:41.670795 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-f7f86c69-3e85-40e5-b735-1d7c685c04c5 req-3f63a3f2-4f17-4b88-89c0-b175614fb870 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038146 Jun 24 08:58:41.671538 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 591/1147] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:58:41.948375 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-aa912bcc-9224-4366-a83e-1d2fa61f2663 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:41.949037 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-aa912bcc-9224-4366-a83e-1d2fa61f2663 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:41.956249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa912bcc-9224-4366-a83e-1d2fa61f2663 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:41.956682 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa912bcc-9224-4366-a83e-1d2fa61f2663 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:41.957490 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa912bcc-9224-4366-a83e-1d2fa61f2663 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:41.957924 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-aa912bcc-9224-4366-a83e-1d2fa61f2663 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:42.116643 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-aa912bcc-9224-4366-a83e-1d2fa61f2663 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:42.129579 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-aa912bcc-9224-4366-a83e-1d2fa61f2663 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 200 len: 1319 microversion: 2.1 time: 0.184718 Jun 24 08:58:42.130609 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 557/1148] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:41 2022] GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:43.151856 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ce01a061-0d6f-4373-96de-442556929112 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:43.152896 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-ce01a061-0d6f-4373-96de-442556929112 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:43.159085 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ce01a061-0d6f-4373-96de-442556929112 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:43.159574 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ce01a061-0d6f-4373-96de-442556929112 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:43.160359 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ce01a061-0d6f-4373-96de-442556929112 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:43.160793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-ce01a061-0d6f-4373-96de-442556929112 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:43.302743 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-ce01a061-0d6f-4373-96de-442556929112 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:43.311060 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ce01a061-0d6f-4373-96de-442556929112 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 200 len: 1319 microversion: 2.1 time: 0.164304 Jun 24 08:58:43.312326 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 592/1149] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:43 2022] GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:44.330277 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-bb7cd5dd-b56f-4ae4-9ac1-75581e3bf85a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:44.330929 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-bb7cd5dd-b56f-4ae4-9ac1-75581e3bf85a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:44.333301 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=2 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:44.333956 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell0:SELECT=6 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:44.340522 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb7cd5dd-b56f-4ae4-9ac1-75581e3bf85a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:44.340970 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb7cd5dd-b56f-4ae4-9ac1-75581e3bf85a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:44.341740 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb7cd5dd-b56f-4ae4-9ac1-75581e3bf85a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:44.342167 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-bb7cd5dd-b56f-4ae4-9ac1-75581e3bf85a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:44.479616 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-bb7cd5dd-b56f-4ae4-9ac1-75581e3bf85a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:44.487399 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-bb7cd5dd-b56f-4ae4-9ac1-75581e3bf85a tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 200 len: 1508 microversion: 2.1 time: 0.161142 Jun 24 08:58:44.487972 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 558/1150] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:44 2022] GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:44.504520 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-7b053127-a473-4da8-91ed-6228db4bcbd9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f9fe952-9fa3-40f6-9f0f-e0490e8c34f0", "device": "/dev/sdb"}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:58:44.506153 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-7b053127-a473-4da8-91ed-6228db4bcbd9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:44.508802 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell0:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:44.514756 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7b053127-a473-4da8-91ed-6228db4bcbd9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:44.515228 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7b053127-a473-4da8-91ed-6228db4bcbd9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:44.516059 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7b053127-a473-4da8-91ed-6228db4bcbd9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:44.516544 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-7b053127-a473-4da8-91ed-6228db4bcbd9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:44.795778 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-7b053127-a473-4da8-91ed-6228db4bcbd9 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "POST /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295319 Jun 24 08:58:44.796397 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 593/1151] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Jun 24 08:58:44 2022] POST /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:59:06.235816 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-8775b0d6-824a-48ef-b345-9ee0efd3f092 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:06.236380 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-8775b0d6-824a-48ef-b345-9ee0efd3f092 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:06.239648 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:06.240559 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=34 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:06.249909 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8775b0d6-824a-48ef-b345-9ee0efd3f092 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:06.250460 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8775b0d6-824a-48ef-b345-9ee0efd3f092 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:06.251530 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8775b0d6-824a-48ef-b345-9ee0efd3f092 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:06.252182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-8775b0d6-824a-48ef-b345-9ee0efd3f092 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:06.343431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.objects.instance [None req-8775b0d6-824a-48ef-b345-9ee0efd3f092 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lazy-loading 'services' on Instance uuid 36ffcf2a-9435-48ae-b9da-01316510df4a {{(pid=124380) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:59:06.422086 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-8775b0d6-824a-48ef-b345-9ee0efd3f092 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "DELETE /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a/os-volume_attachments/9f9fe952-9fa3-40f6-9f0f-e0490e8c34f0" status: 202 len: 0 microversion: 2.1 time: 0.190943 Jun 24 08:59:06.422747 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 559/1152] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Jun 24 08:59:06 2022] DELETE /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a/os-volume_attachments/9f9fe952-9fa3-40f6-9f0f-e0490e8c34f0 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:59:07.536775 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=16 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:07.537596 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:07.541692 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-3d83cd1e-0025-4b75-982d-eebbb498da23 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:07.542263 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3d83cd1e-0025-4b75-982d-eebbb498da23 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:07.549736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3d83cd1e-0025-4b75-982d-eebbb498da23 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:07.550126 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3d83cd1e-0025-4b75-982d-eebbb498da23 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:07.550899 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3d83cd1e-0025-4b75-982d-eebbb498da23 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:07.551354 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-3d83cd1e-0025-4b75-982d-eebbb498da23 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:07.578238 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-3d83cd1e-0025-4b75-982d-eebbb498da23 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Going to try to terminate instance {{(pid=124379) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:59:07.660455 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-3d83cd1e-0025-4b75-982d-eebbb498da23 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "DELETE /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 204 len: 0 microversion: 2.1 time: 0.124593 Jun 24 08:59:07.661352 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 594/1153] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:59:07 2022] DELETE /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:59:07.671928 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-4c818446-cceb-41ad-b05d-590cb5b2f584 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:07.673203 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-4c818446-cceb-41ad-b05d-590cb5b2f584 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:07.679246 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4c818446-cceb-41ad-b05d-590cb5b2f584 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:07.679713 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4c818446-cceb-41ad-b05d-590cb5b2f584 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:07.680558 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4c818446-cceb-41ad-b05d-590cb5b2f584 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:07.680995 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-4c818446-cceb-41ad-b05d-590cb5b2f584 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:07.815059 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-4c818446-cceb-41ad-b05d-590cb5b2f584 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:59:07.823056 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-4c818446-cceb-41ad-b05d-590cb5b2f584 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 200 len: 1514 microversion: 2.1 time: 0.155907 Jun 24 08:59:07.823722 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 560/1154] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:59:07 2022] GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:59:08.841357 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-021dc3a7-53b6-49b0-a86c-0f1aa6b47351 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:08.842081 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-021dc3a7-53b6-49b0-a86c-0f1aa6b47351 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:08.848687 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-021dc3a7-53b6-49b0-a86c-0f1aa6b47351 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:08.849137 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-021dc3a7-53b6-49b0-a86c-0f1aa6b47351 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:08.849896 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-021dc3a7-53b6-49b0-a86c-0f1aa6b47351 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:08.850324 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-021dc3a7-53b6-49b0-a86c-0f1aa6b47351 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:08.986249 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-021dc3a7-53b6-49b0-a86c-0f1aa6b47351 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:59:08.994755 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-021dc3a7-53b6-49b0-a86c-0f1aa6b47351 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 200 len: 1514 microversion: 2.1 time: 0.157609 Jun 24 08:59:08.995350 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 595/1155] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:59:08 2022] GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:59:10.012547 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-59642a65-ebdd-4225-802f-d9f33e807f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:10.013161 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-59642a65-ebdd-4225-802f-d9f33e807f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:10.019736 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59642a65-ebdd-4225-802f-d9f33e807f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:10.020185 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59642a65-ebdd-4225-802f-d9f33e807f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:10.020961 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59642a65-ebdd-4225-802f-d9f33e807f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:10.021392 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-59642a65-ebdd-4225-802f-d9f33e807f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:10.160042 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-59642a65-ebdd-4225-802f-d9f33e807f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dddf53ee2647d08d2c5f3b17f34e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7f78cbcdb45c8946ed1fe9171e7b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:59:10.168012 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-59642a65-ebdd-4225-802f-d9f33e807f2c tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 200 len: 1514 microversion: 2.1 time: 0.159722 Jun 24 08:59:10.169211 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 561/1156] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:59:10 2022] GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:59:10.346226 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [req-74bf8efb-bd37-44bb-8766-50220af213a1 req-937d5596-6c6c-4f19-9191-d1cb5898e308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36ffcf2a-9435-48ae-b9da-01316510df4a", "name": "network-vif-deleted", "tag": "07688bfe-bc5e-4fb9-9f3a-0572410ee17b"}]} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:59:10.356539 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-74bf8efb-bd37-44bb-8766-50220af213a1 req-937d5596-6c6c-4f19-9191-d1cb5898e308 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:10.356986 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [req-74bf8efb-bd37-44bb-8766-50220af213a1 req-937d5596-6c6c-4f19-9191-d1cb5898e308 service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:10.375736 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.compute.server_external_events [req-74bf8efb-bd37-44bb-8766-50220af213a1 req-937d5596-6c6c-4f19-9191-d1cb5898e308 service nova] Creating event network-vif-deleted:07688bfe-bc5e-4fb9-9f3a-0572410ee17b for instance 36ffcf2a-9435-48ae-b9da-01316510df4a on hv-cinder-84517 Jun 24 08:59:10.383100 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [req-74bf8efb-bd37-44bb-8766-50220af213a1 req-937d5596-6c6c-4f19-9191-d1cb5898e308 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040577 Jun 24 08:59:10.384465 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 596/1157] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:59:11.186630 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0a968e9a-8316-46a4-af2c-4c32f548f937 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:11.187265 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-0a968e9a-8316-46a4-af2c-4c32f548f937 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] [instance: 36ffcf2a-9435-48ae-b9da-01316510df4a] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:11.193437 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0a968e9a-8316-46a4-af2c-4c32f548f937 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:11.193884 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0a968e9a-8316-46a4-af2c-4c32f548f937 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:11.194652 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0a968e9a-8316-46a4-af2c-4c32f548f937 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:11.195269 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-0a968e9a-8316-46a4-af2c-4c32f548f937 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:11.208648 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-0a968e9a-8316-46a4-af2c-4c32f548f937 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] HTTP exception thrown: Instance 36ffcf2a-9435-48ae-b9da-01316510df4a could not be found. Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0a968e9a-8316-46a4-af2c-4c32f548f937 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Request method failure captured: Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a HTTP/1.1 Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXxu3fUDrAMcOij21S_w3_dYkBYrDuHISmydNkFg1lYRlkIlHpPf4EPnUGK6Yd7P5llJ1yFcS0avDYRGKD1Ys80ptNA49gdCkiSrFYOVVd3TNYhMxwqb1xWg8-Yc8Rwg4LlKB1csBer8wzm2YWxSMyMvHfpfbjxqdGuN79U7zn5N4OY Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 6fe7f78cbcdb45c8946ed1fe9171e7b1 Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1620984354 Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:59:11.210296 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:59:11.212542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6fe7f78cbcdb45c8946ed1fe9171e7b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6fe7f78cbcdb45c8946ed1fe9171e7b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6fe7f78cbcdb45c8946ed1fe9171e7b1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6fe7f78cbcdb45c8946ed1fe9171e7b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:59:11.212542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-VolumesSnapshotTestJSON-1620984354 Jun 24 08:59:11.212542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 6fe7f78cbcdb45c8946ed1fe9171e7b1 Jun 24 08:59:11.212542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1620984354 Jun 24 08:59:11.212542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-VolumesSnapshotTestJSON-1620984354-project Jun 24 08:59:11.212542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:59:11.212542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:59:11.212542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 60dddf53ee2647d08d2c5f3b17f34e1a Jun 24 08:59:11.212542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-VolumesSnapshotTestJSON-1620984354-project Jun 24 08:59:11.212542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:59:11.212542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 36ffcf2a-9435-48ae-b9da-01316510df4a could not be found. Jun 24 08:59:11.212542 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': '36ffcf2a-9435-48ae-b9da-01316510df4a'} Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36ffcf2a-9435-48ae-b9da-01316510df4a could not be found. Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:59:11.213525 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36ffcf2a-9435-48ae-b9da-01316510df4a could not be found. Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36ffcf2a-9435-48ae-b9da-01316510df4a could not be found. Jun 24 08:59:11.215108 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:11.216632 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-0a968e9a-8316-46a4-af2c-4c32f548f937 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] Returning 404 to user: Instance 36ffcf2a-9435-48ae-b9da-01316510df4a could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:59:11.216632 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-0a968e9a-8316-46a4-af2c-4c32f548f937 tempest-VolumesSnapshotTestJSON-1620984354 tempest-VolumesSnapshotTestJSON-1620984354-project] 10.222.0.43 "GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a" status: 404 len: 111 microversion: 2.1 time: 0.028953 Jun 24 08:59:11.216632 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 562/1158] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:59:11 2022] GET /compute/v2.1/servers/36ffcf2a-9435-48ae-b9da-01316510df4a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:59:22.552322 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:22.553073 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:22.558584 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-056a6016-ac34-4e59-b9a3-5ad1069674cd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:22.559324 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-056a6016-ac34-4e59-b9a3-5ad1069674cd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:22.568812 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-056a6016-ac34-4e59-b9a3-5ad1069674cd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:22.569267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-056a6016-ac34-4e59-b9a3-5ad1069674cd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:22.570071 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-056a6016-ac34-4e59-b9a3-5ad1069674cd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:22.570515 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-056a6016-ac34-4e59-b9a3-5ad1069674cd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:22.596424 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-056a6016-ac34-4e59-b9a3-5ad1069674cd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372/ips" status: 200 len: 149 microversion: 2.1 time: 0.045916 Jun 24 08:59:22.596993 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 597/1159] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Jun 24 08:59:22 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:59:26.021888 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-f3812b06-35c4-46ee-9518-2a1fc78d3e0f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fd3a15c-8f30-44d1-8312-48689b8f3035"}} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:59:26.023024 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-f3812b06-35c4-46ee-9518-2a1fc78d3e0f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:26.025619 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_api:SELECT=8 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:26.026275 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG dbcounter [-] [124380] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:26.033060 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3812b06-35c4-46ee-9518-2a1fc78d3e0f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:26.033569 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3812b06-35c4-46ee-9518-2a1fc78d3e0f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:26.034566 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3812b06-35c4-46ee-9518-2a1fc78d3e0f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:26.035319 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-f3812b06-35c4-46ee-9518-2a1fc78d3e0f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:26.310822 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-f3812b06-35c4-46ee-9518-2a1fc78d3e0f tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "POST /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292745 Jun 24 08:59:26.311805 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 563/1160] 10.222.0.43 () {60 vars in 1322 bytes} [Fri Jun 24 08:59:26 2022] POST /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:59:33.950810 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-cac59912-a700-499d-8878-3ac5390bc07a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:33.951394 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-cac59912-a700-499d-8878-3ac5390bc07a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:33.953449 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_api:SELECT=2 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:33.954096 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG dbcounter [-] [124379] Writing DB stats nova_cell1:SELECT=4 {{(pid=124379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:33.959930 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cac59912-a700-499d-8878-3ac5390bc07a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:33.960380 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cac59912-a700-499d-8878-3ac5390bc07a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:33.961759 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cac59912-a700-499d-8878-3ac5390bc07a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:33.962199 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-cac59912-a700-499d-8878-3ac5390bc07a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:34.040799 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.objects.instance [None req-cac59912-a700-499d-8878-3ac5390bc07a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lazy-loading 'services' on Instance uuid b9620ced-fb2d-4c51-9714-a669cdaf0372 {{(pid=124379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:59:34.111324 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-cac59912-a700-499d-8878-3ac5390bc07a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372/os-volume_attachments/6fd3a15c-8f30-44d1-8312-48689b8f3035" status: 202 len: 0 microversion: 2.1 time: 0.164262 Jun 24 08:59:34.111911 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 598/1161] 10.222.0.43 () {58 vars in 1415 bytes} [Fri Jun 24 08:59:33 2022] DELETE /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372/os-volume_attachments/6fd3a15c-8f30-44d1-8312-48689b8f3035 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:59:34.121455 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-36ea90cb-9dbe-4097-82cd-90c41bd765d6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:34.122528 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-36ea90cb-9dbe-4097-82cd-90c41bd765d6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:34.130130 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36ea90cb-9dbe-4097-82cd-90c41bd765d6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:34.130974 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36ea90cb-9dbe-4097-82cd-90c41bd765d6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:34.132009 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36ea90cb-9dbe-4097-82cd-90c41bd765d6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:34.132517 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-36ea90cb-9dbe-4097-82cd-90c41bd765d6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:34.166039 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-36ea90cb-9dbe-4097-82cd-90c41bd765d6 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049383 Jun 24 08:59:34.166715 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 564/1162] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:59:34 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:59:35.179461 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-52dd8d0d-d404-4c4f-b384-4f01f1ce198d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:35.181667 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-52dd8d0d-d404-4c4f-b384-4f01f1ce198d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:35.188125 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52dd8d0d-d404-4c4f-b384-4f01f1ce198d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:35.188567 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52dd8d0d-d404-4c4f-b384-4f01f1ce198d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:35.189335 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52dd8d0d-d404-4c4f-b384-4f01f1ce198d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:35.189766 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-52dd8d0d-d404-4c4f-b384-4f01f1ce198d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:35.221112 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-52dd8d0d-d404-4c4f-b384-4f01f1ce198d tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046779 Jun 24 08:59:35.221674 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 599/1163] 10.222.0.43 () {58 vars in 1301 bytes} [Fri Jun 24 08:59:35 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:59:35.280972 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-644107f5-3d71-4324-92e2-fd84f71b413b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:35.281564 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-644107f5-3d71-4324-92e2-fd84f71b413b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:35.288132 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-644107f5-3d71-4324-92e2-fd84f71b413b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:35.288588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-644107f5-3d71-4324-92e2-fd84f71b413b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:35.289861 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-644107f5-3d71-4324-92e2-fd84f71b413b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:35.290299 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-644107f5-3d71-4324-92e2-fd84f71b413b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:35.316443 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-644107f5-3d71-4324-92e2-fd84f71b413b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Going to try to terminate instance {{(pid=124380) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:59:35.394699 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-644107f5-3d71-4324-92e2-fd84f71b413b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 204 len: 0 microversion: 2.1 time: 0.117236 Jun 24 08:59:35.395302 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 565/1164] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:59:35 2022] DELETE /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:59:35.404447 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-1a092d73-f1fc-4d52-908a-d31581b7fb48 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:35.405424 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-1a092d73-f1fc-4d52-908a-d31581b7fb48 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:35.420863 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1a092d73-f1fc-4d52-908a-d31581b7fb48 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:35.421319 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1a092d73-f1fc-4d52-908a-d31581b7fb48 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:35.422172 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1a092d73-f1fc-4d52-908a-d31581b7fb48 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:35.422614 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-1a092d73-f1fc-4d52-908a-d31581b7fb48 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:35.572868 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-1a092d73-f1fc-4d52-908a-d31581b7fb48 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:59:35.580393 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-1a092d73-f1fc-4d52-908a-d31581b7fb48 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 200 len: 1680 microversion: 2.1 time: 0.180405 Jun 24 08:59:35.580949 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 600/1165] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:59:35 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:59:36.598383 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-9fe8eac3-40e9-41dd-8f76-c4e5905f7ddd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:36.599090 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-9fe8eac3-40e9-41dd-8f76-c4e5905f7ddd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:36.606266 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9fe8eac3-40e9-41dd-8f76-c4e5905f7ddd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:36.606713 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9fe8eac3-40e9-41dd-8f76-c4e5905f7ddd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:36.607524 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9fe8eac3-40e9-41dd-8f76-c4e5905f7ddd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:36.607969 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-9fe8eac3-40e9-41dd-8f76-c4e5905f7ddd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:36.750908 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.policy [None req-9fe8eac3-40e9-41dd-8f76-c4e5905f7ddd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124380) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:59:36.759499 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-9fe8eac3-40e9-41dd-8f76-c4e5905f7ddd tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 200 len: 1680 microversion: 2.1 time: 0.165654 Jun 24 08:59:36.760087 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 566/1166] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:59:36 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:59:37.781730 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-a742f466-18fa-468e-aba5-37e6d38ca144 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:37.782344 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-a742f466-18fa-468e-aba5-37e6d38ca144 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:37.789917 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a742f466-18fa-468e-aba5-37e6d38ca144 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:37.790372 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a742f466-18fa-468e-aba5-37e6d38ca144 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:37.791182 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a742f466-18fa-468e-aba5-37e6d38ca144 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:37.791837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-a742f466-18fa-468e-aba5-37e6d38ca144 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:37.854559 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.policy [None req-a742f466-18fa-468e-aba5-37e6d38ca144 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3b1f091b4644d3b15b66eee01271c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae612a1712a404681313b8758eb4f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124379) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:59:37.863450 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-a742f466-18fa-468e-aba5-37e6d38ca144 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 200 len: 1612 microversion: 2.1 time: 0.088796 Jun 24 08:59:37.864185 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 601/1167] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:59:37 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 1612 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:59:38.050882 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [req-69ed189d-3185-4f00-aef6-e16e389053c2 req-5127cb75-5668-483b-9c81-a0a8715205ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9620ced-fb2d-4c51-9714-a669cdaf0372", "name": "network-vif-deleted", "tag": "56da151a-1ea1-49ac-b60c-3d17a1089a32"}]} {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:59:38.060286 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-69ed189d-3185-4f00-aef6-e16e389053c2 req-5127cb75-5668-483b-9c81-a0a8715205ff service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:38.060820 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [req-69ed189d-3185-4f00-aef6-e16e389053c2 req-5127cb75-5668-483b-9c81-a0a8715205ff service nova] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:38.073431 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.compute.server_external_events [req-69ed189d-3185-4f00-aef6-e16e389053c2 req-5127cb75-5668-483b-9c81-a0a8715205ff service nova] Creating event network-vif-deleted:56da151a-1ea1-49ac-b60c-3d17a1089a32 for instance b9620ced-fb2d-4c51-9714-a669cdaf0372 on hv-cinder-84517 Jun 24 08:59:38.078996 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [req-69ed189d-3185-4f00-aef6-e16e389053c2 req-5127cb75-5668-483b-9c81-a0a8715205ff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033040 Jun 24 08:59:38.079951 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 567/1168] 10.222.0.43 () {64 vars in 1317 bytes} [Fri Jun 24 08:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:59:38.881880 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-40bd9220-6bf0-4266-8422-bccb3ea5bdb7 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:38.883404 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-40bd9220-6bf0-4266-8422-bccb3ea5bdb7 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:38.890270 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-40bd9220-6bf0-4266-8422-bccb3ea5bdb7 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:38.890780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-40bd9220-6bf0-4266-8422-bccb3ea5bdb7 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:38.891599 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-40bd9220-6bf0-4266-8422-bccb3ea5bdb7 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:38.892043 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-40bd9220-6bf0-4266-8422-bccb3ea5bdb7 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:38.907127 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-40bd9220-6bf0-4266-8422-bccb3ea5bdb7 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] HTTP exception thrown: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-40bd9220-6bf0-4266-8422-bccb3ea5bdb7 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Request method failure captured: Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 HTTP/1.1 Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXsoDQD_CGiUsNKr9vstP-rG5QqwveNeZky3rqPV7DqHcIWRshL6e5u4dzLNBm7Sr4gfjZGKgL8xEQKZc1HjleqJqt3Iule2zeOJPlUoDwnxCRjlrhwAh6B2eK7ZTVPMe6699yI8A59EvBgQQbB1YTc_fZunvpgoIzZNTStObXM3P7g Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:59:38.908936 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:59:38.910550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ae612a1712a404681313b8758eb4f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:59:38.910550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:38.910550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:38.910550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:38.910550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:38.910550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:59:38.910550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:59:38.910550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 8d3b1f091b4644d3b15b66eee01271c6 Jun 24 08:59:38.910550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:38.910550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:59:38.910550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:38.910550 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': 'b9620ced-fb2d-4c51-9714-a669cdaf0372'} Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:59:38.911419 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:38.912780 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:38.914048 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-40bd9220-6bf0-4266-8422-bccb3ea5bdb7 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Returning 404 to user: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:59:38.914048 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-40bd9220-6bf0-4266-8422-bccb3ea5bdb7 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 404 len: 111 microversion: 2.1 time: 0.032594 Jun 24 08:59:38.914048 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 602/1169] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:59:38 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:59:38.921016 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-2340bb65-2bb8-4ca4-b140-5e7b393c1d1b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '.version_select at 0x7fb75cb971f0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:38.946741 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-2340bb65-2bb8-4ca4-b140-5e7b393c1d1b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-507237894" status: 202 len: 0 microversion: 2.1 time: 0.029927 Jun 24 08:59:38.947420 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 568/1170] 10.222.0.43 () {58 vars in 1217 bytes} [Fri Jun 24 08:59:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-507237894 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:59:40.946437 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8f3539e5-8ba9-4a71-a96e-42d29bf69279 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:40.946969 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-8f3539e5-8ba9-4a71-a96e-42d29bf69279 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:40.953401 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8f3539e5-8ba9-4a71-a96e-42d29bf69279 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:40.953843 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8f3539e5-8ba9-4a71-a96e-42d29bf69279 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:40.954595 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8f3539e5-8ba9-4a71-a96e-42d29bf69279 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:40.955025 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-8f3539e5-8ba9-4a71-a96e-42d29bf69279 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:40.968730 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-8f3539e5-8ba9-4a71-a96e-42d29bf69279 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] HTTP exception thrown: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8f3539e5-8ba9-4a71-a96e-42d29bf69279 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Request method failure captured: Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 HTTP/1.1 Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXsoDQD_CGiUsNKr9vstP-rG5QqwveNeZky3rqPV7DqHcIWRshL6e5u4dzLNBm7Sr4gfjZGKgL8xEQKZc1HjleqJqt3Iule2zeOJPlUoDwnxCRjlrhwAh6B2eK7ZTVPMe6699yI8A59EvBgQQbB1YTc_fZunvpgoIzZNTStObXM3P7g Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:59:40.970256 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:59:40.971920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ae612a1712a404681313b8758eb4f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:59:40.971920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:40.971920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:40.971920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:40.971920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:40.971920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:59:40.971920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:59:40.971920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 8d3b1f091b4644d3b15b66eee01271c6 Jun 24 08:59:40.971920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:40.971920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:59:40.971920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:40.971920 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': 'b9620ced-fb2d-4c51-9714-a669cdaf0372'} Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:59:40.973008 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:40.974552 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:40.976495 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-8f3539e5-8ba9-4a71-a96e-42d29bf69279 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Returning 404 to user: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:59:40.976495 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-8f3539e5-8ba9-4a71-a96e-42d29bf69279 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 404 len: 111 microversion: 2.1 time: 0.029093 Jun 24 08:59:40.976495 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 603/1171] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:59:40 2022] DELETE /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:59:40.981203 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3c10e41b-1eb3-4469-a96c-b1fd77947e0b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:40.981942 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-3c10e41b-1eb3-4469-a96c-b1fd77947e0b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: b9620ced-fb2d-4c51-9714-a669cdaf0372] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:40.988082 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c10e41b-1eb3-4469-a96c-b1fd77947e0b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:40.988541 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c10e41b-1eb3-4469-a96c-b1fd77947e0b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:40.989310 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c10e41b-1eb3-4469-a96c-b1fd77947e0b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:40.989748 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-3c10e41b-1eb3-4469-a96c-b1fd77947e0b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:41.003535 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-3c10e41b-1eb3-4469-a96c-b1fd77947e0b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] HTTP exception thrown: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3c10e41b-1eb3-4469-a96c-b1fd77947e0b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Request method failure captured: Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 HTTP/1.1 Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXsoDQD_CGiUsNKr9vstP-rG5QqwveNeZky3rqPV7DqHcIWRshL6e5u4dzLNBm7Sr4gfjZGKgL8xEQKZc1HjleqJqt3Iule2zeOJPlUoDwnxCRjlrhwAh6B2eK7ZTVPMe6699yI8A59EvBgQQbB1YTc_fZunvpgoIzZNTStObXM3P7g Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:59:41.005157 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:59:41.006810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ae612a1712a404681313b8758eb4f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:59:41.006810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:41.006810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:41.006810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:41.006810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:41.006810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:59:41.006810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:59:41.006810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 8d3b1f091b4644d3b15b66eee01271c6 Jun 24 08:59:41.006810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:41.006810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:59:41.006810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:41.006810 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': 'b9620ced-fb2d-4c51-9714-a669cdaf0372'} Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:59:41.008342 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. Jun 24 08:59:41.009726 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:41.010879 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-3c10e41b-1eb3-4469-a96c-b1fd77947e0b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Returning 404 to user: Instance b9620ced-fb2d-4c51-9714-a669cdaf0372 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:59:41.010879 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-3c10e41b-1eb3-4469-a96c-b1fd77947e0b tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372" status: 404 len: 111 microversion: 2.1 time: 0.030390 Jun 24 08:59:41.010879 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 569/1172] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:59:40 2022] GET /compute/v2.1/servers/b9620ced-fb2d-4c51-9714-a669cdaf0372 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:59:42.146572 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-151ff59b-9078-421b-8505-a113f82bb917 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:42.147070 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-151ff59b-9078-421b-8505-a113f82bb917 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:42.153591 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-151ff59b-9078-421b-8505-a113f82bb917 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:42.154041 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-151ff59b-9078-421b-8505-a113f82bb917 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:42.154804 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-151ff59b-9078-421b-8505-a113f82bb917 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:42.155271 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-151ff59b-9078-421b-8505-a113f82bb917 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:42.169226 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-151ff59b-9078-421b-8505-a113f82bb917 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] HTTP exception thrown: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-151ff59b-9078-421b-8505-a113f82bb917 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Request method failure captured: Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 HTTP/1.1 Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXsoDQD_CGiUsNKr9vstP-rG5QqwveNeZky3rqPV7DqHcIWRshL6e5u4dzLNBm7Sr4gfjZGKgL8xEQKZc1HjleqJqt3Iule2zeOJPlUoDwnxCRjlrhwAh6B2eK7ZTVPMe6699yI8A59EvBgQQbB1YTc_fZunvpgoIzZNTStObXM3P7g Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:59:42.170773 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:59:42.172366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ae612a1712a404681313b8758eb4f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:59:42.172366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:42.172366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:42.172366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:42.172366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:42.172366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:59:42.172366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:59:42.172366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 8d3b1f091b4644d3b15b66eee01271c6 Jun 24 08:59:42.172366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:42.172366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:59:42.172366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:59:42.172366 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '87380f13-10e7-4265-92db-f929472ac1a8'} Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:59:42.176267 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:59:42.178114 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.180459 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-151ff59b-9078-421b-8505-a113f82bb917 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Returning 404 to user: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:59:42.180459 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-151ff59b-9078-421b-8505-a113f82bb917 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 404 len: 111 microversion: 2.1 time: 0.029596 Jun 24 08:59:42.180459 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 604/1173] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:59:42 2022] DELETE /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:59:42.183182 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-67234d0b-2490-4966-8a4c-3344a9aaa91a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:42.183829 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-67234d0b-2490-4966-8a4c-3344a9aaa91a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 87380f13-10e7-4265-92db-f929472ac1a8] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:42.190286 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-67234d0b-2490-4966-8a4c-3344a9aaa91a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:42.190740 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-67234d0b-2490-4966-8a4c-3344a9aaa91a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:42.191528 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-67234d0b-2490-4966-8a4c-3344a9aaa91a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:42.191963 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-67234d0b-2490-4966-8a4c-3344a9aaa91a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:42.205071 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-67234d0b-2490-4966-8a4c-3344a9aaa91a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] HTTP exception thrown: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-67234d0b-2490-4966-8a4c-3344a9aaa91a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Request method failure captured: Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 HTTP/1.1 Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXsoDQD_CGiUsNKr9vstP-rG5QqwveNeZky3rqPV7DqHcIWRshL6e5u4dzLNBm7Sr4gfjZGKgL8xEQKZc1HjleqJqt3Iule2zeOJPlUoDwnxCRjlrhwAh6B2eK7ZTVPMe6699yI8A59EvBgQQbB1YTc_fZunvpgoIzZNTStObXM3P7g Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:59:42.206570 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:59:42.208247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ae612a1712a404681313b8758eb4f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:59:42.208247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:42.208247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:42.208247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:42.208247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:42.208247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:59:42.208247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:59:42.208247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 8d3b1f091b4644d3b15b66eee01271c6 Jun 24 08:59:42.208247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:42.208247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:59:42.208247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:59:42.208247 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': '87380f13-10e7-4265-92db-f929472ac1a8'} Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:59:42.209249 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. Jun 24 08:59:42.210790 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.212298 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-67234d0b-2490-4966-8a4c-3344a9aaa91a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Returning 404 to user: Instance 87380f13-10e7-4265-92db-f929472ac1a8 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:59:42.212298 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-67234d0b-2490-4966-8a4c-3344a9aaa91a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8" status: 404 len: 111 microversion: 2.1 time: 0.030086 Jun 24 08:59:42.212298 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 570/1174] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:59:42 2022] GET /compute/v2.1/servers/87380f13-10e7-4265-92db-f929472ac1a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:59:42.216647 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-833d4688-222d-4e2e-ad84-c37983ac036a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:42.217174 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-833d4688-222d-4e2e-ad84-c37983ac036a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:42.223244 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-833d4688-222d-4e2e-ad84-c37983ac036a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:42.223698 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-833d4688-222d-4e2e-ad84-c37983ac036a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:42.224461 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-833d4688-222d-4e2e-ad84-c37983ac036a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:42.224899 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-833d4688-222d-4e2e-ad84-c37983ac036a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:42.238640 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-833d4688-222d-4e2e-ad84-c37983ac036a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] HTTP exception thrown: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-833d4688-222d-4e2e-ad84-c37983ac036a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Request method failure captured: Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 HTTP/1.1 Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXsoDQD_CGiUsNKr9vstP-rG5QqwveNeZky3rqPV7DqHcIWRshL6e5u4dzLNBm7Sr4gfjZGKgL8xEQKZc1HjleqJqt3Iule2zeOJPlUoDwnxCRjlrhwAh6B2eK7ZTVPMe6699yI8A59EvBgQQbB1YTc_fZunvpgoIzZNTStObXM3P7g Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:59:42.240192 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:59:42.241793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ae612a1712a404681313b8758eb4f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:59:42.241793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:42.241793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:42.241793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:42.241793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:42.241793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:59:42.241793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:59:42.241793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 8d3b1f091b4644d3b15b66eee01271c6 Jun 24 08:59:42.241793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:42.241793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:59:42.241793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:59:42.241793 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '08e34ef5-87e8-412a-bfd4-30e2b8918b30'} Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:59:42.243392 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:59:42.244901 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.246525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-833d4688-222d-4e2e-ad84-c37983ac036a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Returning 404 to user: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:59:42.246525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-833d4688-222d-4e2e-ad84-c37983ac036a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 404 len: 111 microversion: 2.1 time: 0.029061 Jun 24 08:59:42.246525 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 605/1175] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:59:42 2022] DELETE /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:59:42.250273 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-63767766-f962-4fa2-a5c3-b9b5416a2122 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:42.250893 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-63767766-f962-4fa2-a5c3-b9b5416a2122 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 08e34ef5-87e8-412a-bfd4-30e2b8918b30] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:42.256888 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63767766-f962-4fa2-a5c3-b9b5416a2122 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:42.257331 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63767766-f962-4fa2-a5c3-b9b5416a2122 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:42.258081 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63767766-f962-4fa2-a5c3-b9b5416a2122 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:42.258514 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-63767766-f962-4fa2-a5c3-b9b5416a2122 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:42.271486 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-63767766-f962-4fa2-a5c3-b9b5416a2122 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] HTTP exception thrown: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-63767766-f962-4fa2-a5c3-b9b5416a2122 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Request method failure captured: Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 HTTP/1.1 Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXsoDQD_CGiUsNKr9vstP-rG5QqwveNeZky3rqPV7DqHcIWRshL6e5u4dzLNBm7Sr4gfjZGKgL8xEQKZc1HjleqJqt3Iule2zeOJPlUoDwnxCRjlrhwAh6B2eK7ZTVPMe6699yI8A59EvBgQQbB1YTc_fZunvpgoIzZNTStObXM3P7g Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:59:42.272984 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:59:42.274576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ae612a1712a404681313b8758eb4f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:59:42.274576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:42.274576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:42.274576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:42.274576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:42.274576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:59:42.274576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:59:42.274576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 8d3b1f091b4644d3b15b66eee01271c6 Jun 24 08:59:42.274576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:42.274576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:59:42.274576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:59:42.274576 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': '08e34ef5-87e8-412a-bfd4-30e2b8918b30'} Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:59:42.275671 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. Jun 24 08:59:42.277159 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:42.278641 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-63767766-f962-4fa2-a5c3-b9b5416a2122 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Returning 404 to user: Instance 08e34ef5-87e8-412a-bfd4-30e2b8918b30 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:59:42.278641 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-63767766-f962-4fa2-a5c3-b9b5416a2122 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30" status: 404 len: 111 microversion: 2.1 time: 0.027792 Jun 24 08:59:42.278641 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 571/1176] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:59:42 2022] GET /compute/v2.1/servers/08e34ef5-87e8-412a-bfd4-30e2b8918b30 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:59:43.417724 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-788fdc2c-abc9-49bf-82d9-14285a2e1d0a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:43.418229 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.compute.api [None req-788fdc2c-abc9-49bf-82d9-14285a2e1d0a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124379) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:43.425236 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-788fdc2c-abc9-49bf-82d9-14285a2e1d0a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:43.425676 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-788fdc2c-abc9-49bf-82d9-14285a2e1d0a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:43.426704 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-788fdc2c-abc9-49bf-82d9-14285a2e1d0a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:43.427435 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG oslo_concurrency.lockutils [None req-788fdc2c-abc9-49bf-82d9-14285a2e1d0a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:43.443331 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-788fdc2c-abc9-49bf-82d9-14285a2e1d0a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] HTTP exception thrown: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-788fdc2c-abc9-49bf-82d9-14285a2e1d0a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Request method failure captured: Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: DELETE /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 HTTP/1.1 Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitXsoDQD_CGiUsNKr9vstP-rG5QqwveNeZky3rqPV7DqHcIWRshL6e5u4dzLNBm7Sr4gfjZGKgL8xEQKZc1HjleqJqt3Iule2zeOJPlUoDwnxCRjlrhwAh6B2eK7ZTVPMe6699yI8A59EvBgQQbB1YTc_fZunvpgoIzZNTStObXM3P7g Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:59:43.444800 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:59:43.446662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ae612a1712a404681313b8758eb4f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:59:43.446662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:43.446662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:43.446662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:43.446662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:43.446662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:59:43.446662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:59:43.446662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: 8d3b1f091b4644d3b15b66eee01271c6 Jun 24 08:59:43.446662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:43.446662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: > Jun 24 08:59:43.446662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:59:43.446662 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '5e7560a2-34d6-476c-ad87-c5b0d2279653'} Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:59:43.447611 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:59:43.449014 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:43.450368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-788fdc2c-abc9-49bf-82d9-14285a2e1d0a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Returning 404 to user: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:59:43.450368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-788fdc2c-abc9-49bf-82d9-14285a2e1d0a tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 404 len: 111 microversion: 2.1 time: 0.032954 Jun 24 08:59:43.450368 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 606/1177] 10.222.0.43 () {58 vars in 1238 bytes} [Fri Jun 24 08:59:43 2022] DELETE /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:59:43.454645 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-890e5881-01e9-42bd-85c4-262e91d2be08 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Calling method '>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:43.455320 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.compute.api [None req-890e5881-01e9-42bd-85c4-262e91d2be08 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] [instance: 5e7560a2-34d6-476c-ad87-c5b0d2279653] Fetching instance by UUID {{(pid=124380) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:59:43.462491 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-890e5881-01e9-42bd-85c4-262e91d2be08 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:43.462931 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-890e5881-01e9-42bd-85c4-262e91d2be08 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:43.463725 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-890e5881-01e9-42bd-85c4-262e91d2be08 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:59:43.464162 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG oslo_concurrency.lockutils [None req-890e5881-01e9-42bd-85c4-262e91d2be08 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Lock "3f4411ef-81df-4f69-8e58-a68a240933fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124380) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:59:43.478042 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.wsgi [None req-890e5881-01e9-42bd-85c4-262e91d2be08 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] HTTP exception thrown: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-890e5881-01e9-42bd-85c4-262e91d2be08 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Request method failure captured: Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: request: GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 HTTP/1.1 Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept: application/json Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Accept-Encoding: identity Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Connection: close Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Length: 0 Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Content-Type: application/json Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Host: 10.222.0.43 Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Openstack-System-Scope: None Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: User-Agent: python-urllib3/1.26.9 Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Auth-Token: gAAAAABitXsoDQD_CGiUsNKr9vstP-rG5QqwveNeZky3rqPV7DqHcIWRshL6e5u4dzLNBm7Sr4gfjZGKgL8xEQKZc1HjleqJqt3Iule2zeOJPlUoDwnxCRjlrhwAh6B2eK7ZTVPMe6699yI8A59EvBgQQbB1YTc_fZunvpgoIzZNTStObXM3P7g Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Id: None Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Domain-Name: None Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Identity-Status: Confirmed Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Is-Admin-Project: True Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Id: default Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Domain-Name: Default Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Project-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Role: reader,member Jun 24 08:59:43.479588 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Roles: reader,member Jun 24 08:59:43.481283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0ae612a1712a404681313b8758eb4f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0ae612a1712a404681313b8758eb4f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:59:43.481283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:43.481283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Id: 0ae612a1712a404681313b8758eb4f2d Jun 24 08:59:43.481283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1974759018 Jun 24 08:59:43.481283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:43.481283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Id: default Jun 24 08:59:43.481283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Domain-Name: Default Jun 24 08:59:43.481283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Id: 8d3b1f091b4644d3b15b66eee01271c6 Jun 24 08:59:43.481283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: X-User-Name: tempest-AttachVolumeNegativeTest-1974759018-project Jun 24 08:59:43.481283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: method: > Jun 24 08:59:43.481283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: exception: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:59:43.481283 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: action_args: {'id': '5e7560a2-34d6-476c-ad87-c5b0d2279653'} Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:59:43.482350 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. Jun 24 08:59:43.483964 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: ERROR nova.api.openstack.wsgi Jun 24 08:59:43.485387 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-890e5881-01e9-42bd-85c4-262e91d2be08 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] Returning 404 to user: Instance 5e7560a2-34d6-476c-ad87-c5b0d2279653 could not be found. {{(pid=124380) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:59:43.485387 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-890e5881-01e9-42bd-85c4-262e91d2be08 tempest-AttachVolumeNegativeTest-1974759018 tempest-AttachVolumeNegativeTest-1974759018-project] 10.222.0.43 "GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653" status: 404 len: 111 microversion: 2.1 time: 0.030152 Jun 24 08:59:43.485387 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 572/1178] 10.222.0.43 () {58 vars in 1235 bytes} [Fri Jun 24 08:59:43 2022] GET /compute/v2.1/servers/5e7560a2-34d6-476c-ad87-c5b0d2279653 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:59:47.754730 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-37dc8279-fe3f-492a-bd4e-7be8f532f059 tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] Action: 'create', calling method: .version_select at 0x7fb75c795ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-597133610", "metadata": {"Type": "work"}}} {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:59:48.085979 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-37dc8279-fe3f-492a-bd4e-7be8f532f059 tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.441963 Jun 24 08:59:48.087085 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 607/1179] 10.222.0.43 () {60 vars in 1155 bytes} [Fri Jun 24 08:59:47 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 444 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 08:59:48.099252 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-b1cd7292-455b-4c33-8a17-0bb7c3d77350 tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] Calling method '.version_select at 0x7fb75cbd65e0>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:48.181834 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-b1cd7292-455b-4c33-8a17-0bb7c3d77350 tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/44d522ca-87e0-4e6c-a584-d919aa94e1ee" status: 200 len: 352 microversion: 2.1 time: 0.086608 Jun 24 08:59:48.182941 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 573/1180] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:59:48 2022] GET /compute/v2.1/os-volumes/44d522ca-87e0-4e6c-a584-d919aa94e1ee => generated 352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:59:49.196544 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-bcc00bb2-714a-4df5-a02e-33272bd9a3b6 tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] Calling method '.version_select at 0x7fb75c8d3700>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:49.243423 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-bcc00bb2-714a-4df5-a02e-33272bd9a3b6 tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/44d522ca-87e0-4e6c-a584-d919aa94e1ee" status: 200 len: 353 microversion: 2.1 time: 0.051204 Jun 24 08:59:49.243983 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 608/1181] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:59:49 2022] GET /compute/v2.1/os-volumes/44d522ca-87e0-4e6c-a584-d919aa94e1ee => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:59:49.255284 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-af2b1a66-5a64-4bfd-b1e7-5be1aacafa3f tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] Calling method '.version_select at 0x7fb75c789b80>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:49.302565 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-af2b1a66-5a64-4bfd-b1e7-5be1aacafa3f tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/44d522ca-87e0-4e6c-a584-d919aa94e1ee" status: 200 len: 353 microversion: 2.1 time: 0.051279 Jun 24 08:59:49.303123 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 574/1182] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:59:49 2022] GET /compute/v2.1/os-volumes/44d522ca-87e0-4e6c-a584-d919aa94e1ee => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:59:49.318695 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-ed5917a2-737d-48da-b4a6-6fe4b31aef89 tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] Calling method '.version_select at 0x7fb75c6c5310>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:49.378286 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-ed5917a2-737d-48da-b4a6-6fe4b31aef89 tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/44d522ca-87e0-4e6c-a584-d919aa94e1ee" status: 202 len: 0 microversion: 2.1 time: 0.063295 Jun 24 08:59:49.378961 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 609/1183] 10.222.0.43 () {58 vars in 1247 bytes} [Fri Jun 24 08:59:49 2022] DELETE /compute/v2.1/os-volumes/44d522ca-87e0-4e6c-a584-d919aa94e1ee => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:59:49.387232 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: DEBUG nova.api.openstack.wsgi [None req-678f2648-2db6-45e4-b546-227b59f0390a tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] Calling method '.version_select at 0x7fb75ca70160>' {{(pid=124380) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:49.434607 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO nova.api.openstack.requestlog [None req-678f2648-2db6-45e4-b546-227b59f0390a tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/44d522ca-87e0-4e6c-a584-d919aa94e1ee" status: 200 len: 352 microversion: 2.1 time: 0.051178 Jun 24 08:59:49.435300 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: [pid: 124380|app: 0|req: 575/1184] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:59:49 2022] GET /compute/v2.1/os-volumes/44d522ca-87e0-4e6c-a584-d919aa94e1ee => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:59:50.448521 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0d977d3a-894f-4a69-92b9-c2284479246d tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] Calling method '.version_select at 0x7fb75c913820>' {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:59:50.475912 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.wsgi [None req-0d977d3a-894f-4a69-92b9-c2284479246d tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] HTTP exception thrown: Volume 44d522ca-87e0-4e6c-a584-d919aa94e1ee could not be found. Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0d977d3a-894f-4a69-92b9-c2284479246d tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] Request method failure captured: Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: request: GET /compute/v2.1/os-volumes/44d522ca-87e0-4e6c-a584-d919aa94e1ee HTTP/1.1 Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept: application/json Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Accept-Encoding: identity Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Connection: close Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Length: 0 Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Content-Type: application/json Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Host: 10.222.0.43 Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Openstack-System-Scope: None Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: User-Agent: python-urllib3/1.26.9 Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Auth-Token: gAAAAABitX0DmhO3UUvy2pAz9P676JOtCaOG5ZQIFSPaVkzbmkPFJG3Y3kkqAurDRBnm-bxMbk6F4ovsPDZxUzo_ve55xWQy_B_qkOSmas4OHUjeOcR4ZRukkkMtiHQPR9E7qE27g_WELm39pnQTmBvzjCtHZYbQu148RpkdTouVYB78B4HVFz0 Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Id: None Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Domain-Name: None Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Identity-Status: Confirmed Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Is-Admin-Project: True Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Id: default Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Domain-Name: Default Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Id: 2eb292d467c14eafa6d20a66ad49f795 Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Project-Name: tempest-VolumesGetTestJSON-1851788612 Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Role: reader,member Jun 24 08:59:50.477891 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Roles: reader,member Jun 24 08:59:50.479671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2eb292d467c14eafa6d20a66ad49f795"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2eb292d467c14eafa6d20a66ad49f795"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2eb292d467c14eafa6d20a66ad49f795", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2eb292d467c14eafa6d20a66ad49f795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}] Jun 24 08:59:50.479671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant: tempest-VolumesGetTestJSON-1851788612 Jun 24 08:59:50.479671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Id: 2eb292d467c14eafa6d20a66ad49f795 Jun 24 08:59:50.479671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-Tenant-Name: tempest-VolumesGetTestJSON-1851788612 Jun 24 08:59:50.479671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User: tempest-VolumesGetTestJSON-1851788612-project Jun 24 08:59:50.479671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Id: default Jun 24 08:59:50.479671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Domain-Name: Default Jun 24 08:59:50.479671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Id: b465582691f842b2a9aa8cac0dbe6804 Jun 24 08:59:50.479671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: X-User-Name: tempest-VolumesGetTestJSON-1851788612-project Jun 24 08:59:50.479671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: method: Jun 24 08:59:50.479671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: exception: Volume 44d522ca-87e0-4e6c-a584-d919aa94e1ee could not be found. Jun 24 08:59:50.479671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: action_args: {'id': '44d522ca-87e0-4e6c-a584-d919aa94e1ee'} Jun 24 08:59:50.479671 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: {{(pid=124379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44d522ca-87e0-4e6c-a584-d919aa94e1ee could not be found. (HTTP 404) (Request-ID: req-f81a1d1a-0f47-47fc-a2dd-cf6531154f8c) Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:50.480805 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:59:50.482433 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44d522ca-87e0-4e6c-a584-d919aa94e1ee could not be found. Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 08:59:50.484273 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:59:50.485837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44d522ca-87e0-4e6c-a584-d919aa94e1ee could not be found. Jun 24 08:59:50.485837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:50.485837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:59:50.485837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:50.485837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:59:50.485837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:59:50.485837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:59:50.485837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:59:50.485837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:59:50.485837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44d522ca-87e0-4e6c-a584-d919aa94e1ee could not be found. Jun 24 08:59:50.485837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: ERROR nova.api.openstack.wsgi Jun 24 08:59:50.485837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: DEBUG nova.api.openstack.wsgi [None req-0d977d3a-894f-4a69-92b9-c2284479246d tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] Returning 404 to user: Volume 44d522ca-87e0-4e6c-a584-d919aa94e1ee could not be found. {{(pid=124379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:59:50.485837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO nova.api.openstack.requestlog [None req-0d977d3a-894f-4a69-92b9-c2284479246d tempest-VolumesGetTestJSON-1851788612 tempest-VolumesGetTestJSON-1851788612-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/44d522ca-87e0-4e6c-a584-d919aa94e1ee" status: 404 len: 109 microversion: 2.1 time: 0.036006 Jun 24 08:59:50.485837 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: [pid: 124379|app: 0|req: 610/1185] 10.222.0.43 () {58 vars in 1244 bytes} [Fri Jun 24 08:59:50 2022] GET /compute/v2.1/os-volumes/44d522ca-87e0-4e6c-a584-d919aa94e1ee => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:00:02.745535 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:00:02.746202 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Fri Jun 24 09:00:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:00:13.992284 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:00:13.993027 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Fri Jun 24 09:00:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:01:46.017579 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:01:46.018175 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Fri Jun 24 09:01:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:01:49.266504 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:01:49.267347 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Fri Jun 24 09:01:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:02:11.177220 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:02:11.177810 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Fri Jun 24 09:02:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:02:12.123068 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:02:12.123718 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Fri Jun 24 09:02:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:03:22.755590 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:03:22.756283 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Fri Jun 24 09:03:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:03:34.002777 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:03:34.003479 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Fri Jun 24 09:03:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:05:06.027172 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:05:06.027789 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Fri Jun 24 09:05:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:05:09.276202 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:05:09.276887 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Fri Jun 24 09:05:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:05:31.185851 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:05:31.186302 dv-cinder-845178-9-iscsi devstack@n-api.service[124379]: Fri Jun 24 09:05:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:05:32.131137 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:05:32.131776 dv-cinder-845178-9-iscsi devstack@n-api.service[124380]: Fri Jun 24 09:05:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!